-- Logs begin at Mon 2022-08-08 15:45:45 UTC, end at Mon 2022-08-08 17:16:06 UTC. -- Aug 08 16:43:08.594548 dv-cinder-852209-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 16:43:08.604195 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 16:43:08.606376 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 16:43:08 2022] *** Aug 08 16:43:08.606376 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 16:43:08.606376 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 16:43:08.606376 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: nodename: dv-cinder-852209-3-iscsi Aug 08 16:43:08.606376 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: machine: x86_64 Aug 08 16:43:08.606376 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: clock source: unix Aug 08 16:43:08.606376 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: pcre jit disabled Aug 08 16:43:08.606376 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: detected number of CPU cores: 4 Aug 08 16:43:08.606376 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: current working directory: / Aug 08 16:43:08.606376 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: detected binary path: /usr/bin/uwsgi-core Aug 08 16:43:08.606376 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: your processes number limit is 47680 Aug 08 16:43:08.607245 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: your memory page size is 4096 bytes Aug 08 16:43:08.607245 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: detected max file descriptor number: 2048 Aug 08 16:43:08.607245 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: lock engine: pthread robust mutexes Aug 08 16:43:08.607245 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: thunder lock: enabled Aug 08 16:43:08.607245 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 16:43:08.607245 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 16:43:08.648212 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: Python main interpreter initialized at 0x558a231a39c0 Aug 08 16:43:08.648212 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: python threads support enabled Aug 08 16:43:08.648212 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: your server socket listen backlog is limited to 100 connections Aug 08 16:43:08.648212 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: your mercy for graceful operations on workers is 90 seconds Aug 08 16:43:08.648595 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 16:43:08.648680 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: *** Operational MODE: preforking *** Aug 08 16:43:08.648887 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: *** uWSGI is running in multiple interpreter mode *** Aug 08 16:43:08.648887 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: spawned uWSGI master process (pid: 115750) Aug 08 16:43:08.649100 dv-cinder-852209-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 16:43:08.649917 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: spawned uWSGI worker 1 (pid: 115752, cores: 1) Aug 08 16:43:08.650013 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: spawned uWSGI worker 2 (pid: 115753, cores: 1) Aug 08 16:43:08.650996 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 16:43:09.314885 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 16:43:09.320062 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 16:43:10.406376 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:43:10.406376 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: from cryptography.utils import int_from_bytes Aug 08 16:43:10.407109 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:43:10.407109 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: from cryptography.utils import int_from_bytes Aug 08 16:43:10.408221 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:43:10.408221 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: from cryptography.utils import int_from_bytes Aug 08 16:43:10.408344 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:43:10.408344 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: from cryptography.utils import int_from_bytes Aug 08 16:43:12.886473 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 16:43:12.887103 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 16:43:12.887270 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 16:43:12.887628 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 16:43:12.887881 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 16:43:12.888261 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.888581 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.888895 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.889210 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.889538 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.889845 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.890158 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.890470 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.890818 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.891077 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.891385 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.892267 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-3-iscsi {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.892589 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.892859 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 16:43:12.893268 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.893395 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 16:43:12.893482 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.893482 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.893635 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 16:43:12.893774 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.893993 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 16:43:12.894083 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.894252 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 16:43:12.894378 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.894682 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.894905 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.895019 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.896050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.896195 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.896309 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.896408 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.896408 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.896607 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.896607 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.896769 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.896769 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.896982 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.897064 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.897197 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.897289 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.897379 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.897469 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.897559 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.897740 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.897835 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.898046 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.898151 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-3-iscsi {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.898442 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-3-iscsi {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.898547 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.898778 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.898922 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.899089 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.899194 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.899402 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.899501 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.899733 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.899830 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.900059 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.900194 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.900367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.900454 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.900702 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.900873 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.901032 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.901188 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.901315 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.901499 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.901650 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.901814 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.901970 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.902152 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.902287 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.902468 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.902689 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.902846 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.902934 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.903146 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.903234 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.903457 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.903546 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.903781 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.903868 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.904085 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.904182 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.904387 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.904487 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-3-iscsi {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.904636 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.904785 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.904948 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.905151 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.905251 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.905402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.905571 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.905814 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.905904 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.906127 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.906225 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.906376 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.906475 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.906715 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.906821 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.907035 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.907740 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.907877 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.908033 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.908197 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.908387 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.908469 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.908829 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.908935 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.909084 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.909177 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.909349 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.909502 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.909647 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.909744 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.909954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.910051 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.910262 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.910348 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.910608 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.910726 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.910905 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.911046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.911208 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.911295 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.911523 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.911624 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.911877 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.911979 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.912150 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.912239 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.912454 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.912552 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.912789 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.912973 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.913074 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.913156 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.913283 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.913398 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.913606 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.913698 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.913928 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.914056 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.914281 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.914371 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.914604 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.914695 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.914911 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.915122 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.915223 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.915314 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.915520 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.915610 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.915831 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.915926 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.916079 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.916165 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.916375 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.916462 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.916675 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.916784 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.916991 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.917094 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.917292 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.917377 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.917592 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.917694 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.917892 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.917979 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.918189 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.918338 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.918489 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.918609 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.918819 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.919004 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.919149 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.919291 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.919445 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.919585 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.919732 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.919873 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.920053 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.920214 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.920370 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.920567 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.920720 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.920864 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.921003 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.921157 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.921309 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.921473 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.921625 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.921772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.921913 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.922052 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.922200 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.922339 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.922489 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.922742 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.922898 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.923145 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.923299 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.923441 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.923588 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.923729 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.923868 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.924017 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.924168 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.924315 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.924456 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.924603 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.924738 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.924880 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.925047 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.925180 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.925324 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.925464 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.925618 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.925768 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.925916 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.926056 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.926205 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.926345 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.926495 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.926697 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.926848 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.926988 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.927136 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.927276 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.927422 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.927571 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.927711 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.927850 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.928013 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.928155 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.928310 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.928459 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.928599 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.928738 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.928884 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.929030 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.929188 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.929329 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.929469 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.929617 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.929757 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.930356 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.930446 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.930528 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.930625 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.930708 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.930800 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.930891 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.930973 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.931052 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.931182 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.931338 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.931509 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.931658 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.931850 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.931967 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.932165 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.932276 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.932497 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.932596 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.932825 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.932922 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.933142 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.933230 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.933452 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.933542 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.933761 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.933878 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.934085 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.934173 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.934396 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.934543 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.934734 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.934820 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.935028 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.935116 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.935343 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.935442 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.935657 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.935744 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.935971 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.936059 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.936272 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.936369 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.936585 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.936680 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.936900 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.936996 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.937212 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.937312 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.937527 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.937630 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.937840 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.937939 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.938155 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.938242 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:43:12.938486 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.938665 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.938852 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.939020 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.939198 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.939446 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.939634 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.939771 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.939862 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.940113 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.940204 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.940423 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.940509 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.940731 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.940819 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.941040 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.941129 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.941359 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.941447 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.941686 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.941772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.941993 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.942081 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.942312 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.942410 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.942630 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.942736 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.942940 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.943029 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.943249 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.943337 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.943556 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.943659 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.943863 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.943952 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.944197 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.944284 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.944507 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.944652 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.944817 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.944917 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.945126 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.945233 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.945438 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.945542 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.945733 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.945822 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.946039 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.946128 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.946344 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.946437 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.946665 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.946756 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.946965 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.947054 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.947267 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.947358 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.947572 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.947669 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.947873 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.947962 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.948186 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.948279 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.948509 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.948606 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.948810 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.948900 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.949141 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.949230 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.949442 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.949530 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.949756 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.949857 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.950062 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.950150 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.950369 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.950457 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.950703 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.950813 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.951011 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.951168 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.951317 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.951488 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.951617 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.951828 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.951925 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.952148 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.952235 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.952467 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.952554 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.952782 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.952872 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.953103 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.953204 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.953401 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.953495 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.953708 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.953798 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.954795 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.954940 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.954940 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.955162 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.955274 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.955382 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.955509 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.955665 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.955813 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.955983 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.956102 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.956292 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.956451 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.956623 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.956712 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.957206 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.957302 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.957527 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.957632 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.957857 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.957964 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.958170 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.958299 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.958484 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.958621 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.958842 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.958943 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.959159 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.959254 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.959468 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.959556 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.959783 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.959880 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.960098 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.960190 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.960403 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.960490 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.960707 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.960805 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.961008 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.961112 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.961309 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.961397 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.961611 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.961715 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.961910 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.962003 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.962224 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.962310 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.962527 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.962681 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.962849 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.962946 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.963148 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.963249 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.963447 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.963536 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.963769 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.963858 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.964075 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.964162 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.964399 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.964495 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.964716 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.964804 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.965029 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.965116 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.965350 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.965488 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.965658 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.965750 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.965970 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.966069 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.966277 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.966373 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.966602 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.966706 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.966911 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.967025 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.967219 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.967332 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.967533 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.967646 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.967839 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.967940 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.968152 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.968249 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.968459 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.968547 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.968779 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.968881 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.969086 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.969186 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.969402 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.969490 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.970347 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.970449 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.970696 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.970831 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.971141 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.971272 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.971472 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.971563 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.971785 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.971873 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.972108 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.972195 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.972413 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.972502 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.972727 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.972815 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.973034 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.973136 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.973342 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.973431 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.973648 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.973736 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.973955 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.974140 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.974270 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.974475 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.974599 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.974822 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.974911 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.975146 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.975245 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.975485 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.975589 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.975778 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.975870 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.976087 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.976177 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.976389 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.976485 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.976697 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.976785 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.977018 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.977107 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.977347 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.977451 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.977780 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.977880 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.977961 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.978044 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.978264 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.978364 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.978596 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.978768 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.978899 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.978989 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.979205 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.979303 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.979507 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.979605 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.979814 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.979904 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.980120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.980209 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.980429 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.980527 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.980737 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.980825 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.981044 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.981140 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.981345 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.981452 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.981656 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.981753 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.981960 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.982049 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.982259 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.982349 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.982560 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.982667 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.982895 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.982983 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.983215 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.983306 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.983521 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.983609 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.983840 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.983930 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.984158 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.984251 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.984460 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.984548 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.984760 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.984848 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.985076 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.985175 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.985530 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.985621 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.985768 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.985920 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.986082 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.986162 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.986382 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.986479 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.986740 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.986845 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.987048 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.987136 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.987350 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.987438 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.987661 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.987757 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.987974 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.988079 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.988278 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.988374 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.988590 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.988686 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.988893 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.988988 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.989199 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.989295 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.989509 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.989598 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.989816 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.989920 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.990123 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.990219 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.990425 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.990524 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.990758 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.990847 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.991069 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.991159 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.991370 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.991459 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.991689 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.991785 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.991996 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.992084 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.992301 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.992394 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.992604 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.992692 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.992904 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.992992 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.993209 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.993306 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.993522 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.993609 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.993833 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.994099 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.994210 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.994425 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.994522 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.994767 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.994891 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.995068 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.995156 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.995388 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.995486 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.995708 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.995831 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.996026 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.996162 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.996348 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.996486 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.996658 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.996771 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.997019 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.997129 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.997291 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.997382 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.997595 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.997691 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.997897 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.998000 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.998208 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.998297 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.998512 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.998635 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.998840 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.998931 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.999144 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.999240 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.999453 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.999542 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.999759 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:12.999849 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.000063 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.000168 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.000359 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.000482 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.000661 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.000801 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.001499 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.001616 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.001798 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.001919 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.002106 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.002237 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.002431 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.002557 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.002753 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.003060 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.003150 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.003359 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.003471 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.003659 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.003794 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.003960 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.004117 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.004297 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.004441 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.004598 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.004763 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.004932 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.005097 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.005255 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.005426 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.005593 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.005779 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.005916 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.006191 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.006304 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.006388 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.006512 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.006729 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.006823 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.007077 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.007183 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.007351 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.007440 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.007660 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.007759 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.007967 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.008064 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.008263 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.008351 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.008566 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.008663 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.008869 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.008960 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.009173 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.009261 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.009477 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.009580 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.009774 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.009866 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.010083 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.010172 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.010382 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.010479 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.010712 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.010805 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.011016 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.011105 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.011315 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.011419 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.011612 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.011700 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.011916 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.012011 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.012219 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.012309 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.012516 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.012617 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.012822 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.012916 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.013115 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.013254 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.013413 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.013510 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.013715 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.013835 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.014013 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.014126 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.014309 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.014435 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.014630 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.014769 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.014936 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.015098 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.015235 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.015406 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.015551 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.015715 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.015856 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.016023 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.016155 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.016339 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.016479 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.017360 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.017562 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.017703 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.017851 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.017992 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.018130 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.018277 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.018417 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.018554 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.018662 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.018829 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.018975 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.019135 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.019277 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.019449 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.019583 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.019756 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.019926 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.020172 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.020269 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.020475 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.020633 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.020782 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.020880 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.021080 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.021169 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.021379 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.021467 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.021679 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.021777 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.021979 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.022068 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.022278 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.022366 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.022620 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.022725 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.022920 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.023037 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.023236 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.023334 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.023537 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.023628 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.023835 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.023923 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.024148 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.024244 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.024458 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.024557 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.024764 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.024854 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.025088 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.025181 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.025396 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.025491 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.025701 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.025797 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.026009 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.026131 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.026314 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.026457 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.026641 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.026755 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.026942 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.027094 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.027253 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.027342 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.027557 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.027644 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.027862 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.027966 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.028164 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.028292 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.028459 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.028549 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.028762 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.028873 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.029069 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.029156 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.029373 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.029459 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.029679 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.029775 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.029985 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.030079 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.030290 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.030381 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.030615 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.030706 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.030922 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.031013 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.031226 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.031355 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.031536 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.031650 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.031835 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.031931 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.032165 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.032272 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.032470 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.032581 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.032857 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.032950 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.033168 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.033254 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.033477 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.033575 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.033781 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.033868 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.034085 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.034202 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.034390 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.034479 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.034719 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.034827 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.035019 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.035121 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.035339 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.035429 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.035645 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.035733 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.035947 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.036048 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.036255 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.036361 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.036572 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.036674 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.036847 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.036953 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.037153 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.037268 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.037454 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.037549 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.037777 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.037874 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.038092 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.038180 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.038405 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.038492 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.038748 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.038837 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.039057 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.039176 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.039366 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.039472 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.039675 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.039773 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.039971 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.040068 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.040289 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.040397 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.040597 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.040688 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.040906 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.040995 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.041216 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.041313 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.041530 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.041618 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.041827 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.041922 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.042131 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.042230 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.042442 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.042530 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.042767 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.042867 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.043060 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.043163 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.043359 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.043463 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.043667 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.043755 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.043963 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.044060 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.044281 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.044369 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.044594 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.044696 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.044926 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.045016 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.045236 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.045324 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.045541 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.045668 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.045854 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.045974 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.046222 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.046324 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.046646 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.046749 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.046912 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.047002 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.047224 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.047312 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.047520 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.047608 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.047854 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.047945 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.048167 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.048265 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.048488 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.048766 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.048865 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.049088 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.049177 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.049391 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.049478 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.049691 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.049806 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.050007 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.050121 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.050328 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.050429 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.050656 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.050749 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.050977 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.051077 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.051339 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.051435 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.051695 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.051848 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.051994 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.052092 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.052307 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.052427 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.052614 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.052711 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.052915 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.053006 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.053215 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.053303 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.053521 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.053619 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.053819 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.053908 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.054118 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.054243 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.054480 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.054605 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.054805 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.054896 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.055111 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.055276 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.055415 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.055590 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.055718 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.055902 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.056018 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.056232 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.056384 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.056558 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.056753 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.056889 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.057009 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.057199 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.057319 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.057509 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.057605 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.057817 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.057913 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.058133 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.058238 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.058435 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.058543 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.058778 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.058874 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.059081 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.059254 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.059380 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.059469 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.059681 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.059770 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.059982 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.060093 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.060310 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.060406 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.060610 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.060711 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.060926 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.061015 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.061251 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.061340 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.061576 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.061664 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.061882 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.061979 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.062211 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.062299 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.062530 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.062640 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.062862 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.062960 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.063172 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.063259 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.064000 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.064091 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.064327 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.064444 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.064739 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.064827 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.065049 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.065145 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.065350 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.065438 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.065666 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.065761 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.065955 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.066074 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.066274 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.066456 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.066594 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.066729 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.066888 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.067057 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.067146 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.067366 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.067454 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.067693 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.067780 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.068010 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.068106 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.068333 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.068421 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.068633 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.068728 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.068936 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.069022 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.069246 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.069336 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.069560 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.069659 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.069858 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.069944 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.070162 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.070250 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.070469 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.070583 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.070809 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.070897 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.071121 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.071220 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.071429 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.071526 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.071737 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.071824 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.072045 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.072131 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.072353 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.072441 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.072661 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.072755 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.072967 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.073054 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.073270 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.073358 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.073579 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.073666 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.073886 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.073990 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.074197 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.074286 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.074625 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.074751 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.074917 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.075080 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.075227 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.075394 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.075537 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.075721 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.075845 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.076020 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.076149 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.076312 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.076458 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.076629 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.076768 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.076951 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.077101 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.077325 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.077460 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.077558 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.077707 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.077826 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.078031 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.078146 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.078344 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.078446 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.078675 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.078793 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.079054 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.079752 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.079873 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.080115 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.080216 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.080436 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.080526 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.080748 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.080845 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.081059 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.081162 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.081412 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.081526 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.081724 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.081822 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.082294 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.082396 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.082623 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.082713 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.082938 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.083025 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.083247 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.083337 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.083552 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.083651 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.083858 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.083953 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.084168 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.084256 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.084474 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.084561 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.084780 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.084877 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.085086 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.085173 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.085393 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.085619 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.085712 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.085954 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.086043 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.086268 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.086356 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.086632 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.086729 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.086913 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.087163 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.087256 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.087378 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.087547 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.087640 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.087827 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.088028 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.088138 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.088341 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.088450 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.088672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.088765 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.088995 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.089185 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.089317 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.089511 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.089679 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.089838 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.089928 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.090176 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.090264 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.090495 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.090608 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.090837 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.090923 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.091145 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.091232 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.091451 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.091548 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.091775 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.091862 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.092093 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.092180 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.092400 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.092496 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.092699 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.092787 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.093015 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.093111 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.093320 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.093414 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.093648 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.093842 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.093963 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.094185 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.094274 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.094514 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.094671 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.094917 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.095142 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.095269 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.095470 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.095573 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.095791 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.095879 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.096117 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.096218 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.096434 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.096521 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.096738 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.096843 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.097075 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.097179 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.097388 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.097532 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.097688 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.097776 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.097988 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.098078 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.098295 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.098536 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.098693 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.098889 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.098990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.099205 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.099292 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.099504 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.099591 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.099822 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.099918 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.100125 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.100253 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.100431 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.100585 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.100731 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.100926 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.101055 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.101232 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.101325 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.101540 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.101647 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.101855 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.101953 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.102168 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.102266 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.102474 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.102595 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.102798 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.102904 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.103103 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.103195 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.103403 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.103506 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.103706 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.103796 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.104004 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.104092 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.104308 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.104584 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.104675 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.104911 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.104998 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.105209 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.105307 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.105554 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.105642 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.105869 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.105963 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.106175 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.106282 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.106494 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.106604 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.106830 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.106995 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.107129 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.107292 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.107449 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.107600 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.107748 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.107887 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.108137 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.108281 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.108507 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.108654 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.108805 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.108943 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.109093 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.109228 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.109395 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.109528 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.109702 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.109835 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.110018 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.110151 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.110350 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.110526 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.110697 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.110852 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.111091 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.111181 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.111407 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.111496 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.111715 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.111812 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.112032 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.112119 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.112336 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.112430 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.112639 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.112740 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.112945 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.113032 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.113250 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.113336 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.113554 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.113669 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.113861 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.113957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.114160 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.114247 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.114462 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.114558 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.114790 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.114879 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.115094 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.115182 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.115401 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.115490 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.115707 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.115793 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.116035 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.116121 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.116339 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.116426 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.116648 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.116742 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.116958 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.117045 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.117265 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.117406 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.117570 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.117702 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.117876 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.118021 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.118180 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.118337 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.118490 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.118711 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.118839 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.119034 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.119133 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.119435 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.119570 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.119846 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.119942 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.120151 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.120264 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.120470 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.120606 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.120785 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.120945 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.121091 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.121257 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.121409 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.121565 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.121727 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.121873 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.122031 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.122202 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.122346 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.122518 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.122674 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.122870 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.123002 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.123181 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.123336 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.123497 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.123661 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.123810 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.123982 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.124121 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.124284 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.124419 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.124584 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.124736 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.124883 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.125048 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.125189 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.125359 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.125502 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.125669 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.125807 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.126646 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.126738 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.127025 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.127171 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.127345 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.127471 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.127667 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.127796 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.127984 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.128072 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.128284 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.128379 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.128583 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.128670 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.128890 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.128991 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.129186 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.129274 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.129486 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.129574 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.129788 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.129878 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.130088 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.130175 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.130386 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.130483 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.130704 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.130794 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.131017 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.131104 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.131358 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.131464 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.131661 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.131757 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.131960 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.132108 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.132259 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.132426 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.132558 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.132749 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.132884 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.133071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.133214 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.133383 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.133522 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.133706 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.133838 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.134031 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.134132 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.134343 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.134431 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.134758 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.134871 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.135076 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.135180 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.135394 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.135509 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.135701 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.135852 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.136004 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.136186 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.136333 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.136567 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.136669 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.136832 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.136930 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.137141 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.137284 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.137448 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.137583 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.137761 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.137857 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.138084 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.138184 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.138396 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.138485 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.138727 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.138830 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.139030 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.139127 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.139340 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.139426 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.139645 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.139741 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.139951 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.140038 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.140256 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.140352 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.140561 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.140649 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.140868 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.140954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.141171 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.141265 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.141580 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.142168 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.142445 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.142532 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.142779 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.142880 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.143088 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.143178 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.143393 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.143480 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.143698 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.143798 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.144003 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.144096 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.144310 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.144397 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.144617 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.144717 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.144922 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.145058 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.145227 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.145315 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.145537 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.145633 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.145861 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.145956 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.146184 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.146271 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.146512 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.146631 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.146844 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.146937 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.147165 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.147251 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.147499 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.147595 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.147827 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.147948 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.148135 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.148221 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.148438 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.148534 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.148679 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 16:43:13.148767 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.149073 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.149384 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.149698 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.150012 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.150325 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.150659 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.150971 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.151300 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.151630 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.151935 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.152263 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.152583 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.152933 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.153236 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.153539 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.153870 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.154183 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.154497 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.154834 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.155149 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.155463 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.155783 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.156097 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.156416 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.156736 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.157092 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.157417 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.157742 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.158149 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.158483 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.158840 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.159196 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.159513 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.159907 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.160219 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.160535 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.160852 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.161162 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:43:13.161409 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 16:43:13.302320 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO dbcounter [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Registered counter for database nova_api Aug 08 16:43:13.317283 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO dbcounter [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Registered counter for database nova_api Aug 08 16:43:13.324703 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_db.sqlalchemy.engines [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:43:13.331862 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writer thread running {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:43:13.340021 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG oslo_db.sqlalchemy.engines [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:43:13.346826 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG dbcounter [-] [115752] Writer thread running {{(pid=115752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:43:13.388004 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.context [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),24395fe2-62ef-4f67-8fb3-2dbb6cef8108(cell1) {{(pid=115753) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 16:43:13.392425 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:43:13.392890 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:43:13.394452 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:43:13.395190 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:43:13.395632 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:43:13.397602 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:43:13.399604 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO dbcounter [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Registered counter for database nova_cell0 Aug 08 16:43:13.404216 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.context [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),24395fe2-62ef-4f67-8fb3-2dbb6cef8108(cell1) {{(pid=115752) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 16:43:13.404993 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO dbcounter [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Registered counter for database nova_cell1 Aug 08 16:43:13.408657 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG oslo_concurrency.lockutils [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:43:13.409125 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG oslo_concurrency.lockutils [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:43:13.410731 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG oslo_concurrency.lockutils [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:43:13.411496 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG oslo_concurrency.lockutils [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:43:13.411950 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG oslo_concurrency.lockutils [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:43:13.412879 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_db.sqlalchemy.engines [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:43:13.414001 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG oslo_concurrency.lockutils [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:43:13.415667 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_db.sqlalchemy.engines [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:43:13.416286 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO dbcounter [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Registered counter for database nova_cell0 Aug 08 16:43:13.419920 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writer thread running {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:43:13.421906 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO dbcounter [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Registered counter for database nova_cell1 Aug 08 16:43:13.429170 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG oslo_db.sqlalchemy.engines [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:43:13.431324 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG oslo_db.sqlalchemy.engines [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:43:13.436355 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG dbcounter [-] [115752] Writer thread running {{(pid=115752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:43:13.439385 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG dbcounter [-] [115752] Writer thread running {{(pid=115752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:43:13.559012 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writer thread running {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:43:13.569571 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO dbcounter [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Registered counter for database nova_cell0 Aug 08 16:43:13.578838 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_db.sqlalchemy.engines [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:43:13.584551 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writer thread running {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:43:13.585926 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO dbcounter [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Registered counter for database nova_cell0 Aug 08 16:43:13.593187 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG oslo_db.sqlalchemy.engines [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:43:13.598219 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG dbcounter [-] [115752] Writer thread running {{(pid=115752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:43:14.025159 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: WARNING keystonemiddleware.auth_token [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:43:14.031971 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: WARNING keystonemiddleware.auth_token [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:43:14.032989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: WARNING keystonemiddleware.auth_token [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:43:14.039383 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: WARNING keystonemiddleware.auth_token [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:43:14.381999 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: WARNING keystonemiddleware.auth_token [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:43:14.384783 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: WARNING keystonemiddleware.auth_token [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:43:14.387968 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: WARNING keystonemiddleware.auth_token [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:43:14.390692 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: WARNING keystonemiddleware.auth_token [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:43:14.393808 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558a231a39c0 pid: 115752 (default app) Aug 08 16:43:14.395953 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:43:14.397129 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-e22e9593-f776-41a7-a846-26a4316acc3c None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001754 Aug 08 16:43:14.397250 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558a231a39c0 pid: 115753 (default app) Aug 08 16:43:14.397540 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Mon Aug 8 16:43:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:44:36.461059 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:44:36.462187 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002077 Aug 08 16:44:36.462870 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:44:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:44:36.474885 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG dbcounter [-] [115752] Writing DB stats nova_api:SELECT=3 {{(pid=115752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:44:36.475850 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG dbcounter [-] [115752] Writing DB stats nova_cell1:SELECT=3 {{(pid=115752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:44:36.477470 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG dbcounter [-] [115752] Writing DB stats nova_cell0:SELECT=3 {{(pid=115752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:44:36.478401 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG dbcounter [-] [115752] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:44:37.463490 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-308d0b65-a3a2-4c3e-9c27-23715c23552c admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:44:37.507629 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-308d0b65-a3a2-4c3e-9c27-23715c23552c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.038132 Aug 08 16:44:37.509066 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1292 bytes} [Mon Aug 8 16:44:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:44:40.033811 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:44:40.035794 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-9601efce-4b6a-49fb-9e3d-e85e43044653 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002252 Aug 08 16:44:40.040233 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 2/4] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:44:40 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:44:40.681475 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-5ded3a63-9262-426e-974c-d099fa339f56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "rxtx_factor": 1.0}} {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:44:40.720924 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:44:40.720924 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: warnings.warn(msg) Aug 08 16:44:40.830556 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-5ded3a63-9262-426e-974c-d099fa339f56 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.787559 Aug 08 16:44:40.832090 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 3/5] 10.222.0.13 () {64 vars in 1283 bytes} [Mon Aug 8 16:44:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:44:41.265302 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-aae62f80-896c-4029-aa0f-fbc110768391 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:44:41.270985 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:44:41.270985 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: warnings.warn(msg) Aug 08 16:44:41.277038 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writing DB stats nova_api:SELECT=3 {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:44:41.277038 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writing DB stats nova_cell0:SELECT=3 {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:44:41.279154 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writing DB stats nova_cell1:SELECT=3 {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:44:41.282168 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:44:41.463269 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-aae62f80-896c-4029-aa0f-fbc110768391 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.617513 Aug 08 16:44:41.466630 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 3/6] 10.222.0.13 () {64 vars in 1336 bytes} [Mon Aug 8 16:44:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:44:44.539598 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-5ded3a63-9262-426e-974c-d099fa339f56 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:44:44.541504 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-5ded3a63-9262-426e-974c-d099fa339f56 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003270 Aug 08 16:44:44.542246 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 4/7] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:44:44 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:44:45.556770 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-6b1da21c-0fe9-415b-ba22-e0682f2b08db admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "disk": 5, "vcpus": 1}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:44:45.576935 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:44:45.576935 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: warnings.warn(msg) Aug 08 16:44:45.687942 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-6b1da21c-0fe9-415b-ba22-e0682f2b08db admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.134718 Aug 08 16:44:45.689103 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 4/8] 10.222.0.13 () {64 vars in 1283 bytes} [Mon Aug 8 16:44:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 16:44:45.703063 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-38d3416f-eda3-4bcb-8712-54efe0d3183e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:44:45.707559 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:44:45.707559 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: warnings.warn(msg) Aug 08 16:44:45.808180 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-38d3416f-eda3-4bcb-8712-54efe0d3183e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109442 Aug 08 16:44:45.808994 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 5/9] 10.222.0.13 () {64 vars in 1336 bytes} [Mon Aug 8 16:44:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:44:48.473931 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-6b1da21c-0fe9-415b-ba22-e0682f2b08db admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:44:48.475666 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-6b1da21c-0fe9-415b-ba22-e0682f2b08db admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002578 Aug 08 16:44:48.476676 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:44:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:44:48.909683 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-3e62b357-e2e0-4473-ad72-9f0cd57e7a0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:44:49.009767 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-3e62b357-e2e0-4473-ad72-9f0cd57e7a0a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.523389 Aug 08 16:44:49.010338 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 6/11] 10.222.0.13 () {64 vars in 1283 bytes} [Mon Aug 8 16:44:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:44:49.022863 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-dc8b6694-2e4e-491f-bb35-d8065a1d31e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:44:49.122463 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-dc8b6694-2e4e-491f-bb35-d8065a1d31e2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103415 Aug 08 16:44:49.123180 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 6/12] 10.222.0.13 () {64 vars in 1336 bytes} [Mon Aug 8 16:44:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:44:51.551743 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-3e62b357-e2e0-4473-ad72-9f0cd57e7a0a admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:44:51.552747 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-3e62b357-e2e0-4473-ad72-9f0cd57e7a0a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 08 16:44:51.553153 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 7/13] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:44:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:44:52.069215 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-ebeb8767-2f32-4bf1-b0c4-4fd200edc5f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "disk": 10, "vcpus": 2, "name": "ds2G"}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:44:52.163209 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-ebeb8767-2f32-4bf1-b0c4-4fd200edc5f1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.602334 Aug 08 16:44:52.164608 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 7/14] 10.222.0.13 () {64 vars in 1283 bytes} [Mon Aug 8 16:44:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:44:52.178492 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-baf1ac37-5b25-4939-b445-9a009501e745 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:44:52.288399 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-baf1ac37-5b25-4939-b445-9a009501e745 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114770 Aug 08 16:44:52.298656 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 8/15] 10.222.0.13 () {64 vars in 1336 bytes} [Mon Aug 8 16:44:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:44:54.684570 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-ebeb8767-2f32-4bf1-b0c4-4fd200edc5f1 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:44:54.685720 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-ebeb8767-2f32-4bf1-b0c4-4fd200edc5f1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Aug 08 16:44:54.686235 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 8/16] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:44:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:44:55.177526 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-fe7c676d-59c7-4aae-8b1b-6bc2257a1365 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "ram": 4096, "vcpus": 4, "disk": 20, "rxtx_factor": 1.0}} {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:44:55.402167 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-fe7c676d-59c7-4aae-8b1b-6bc2257a1365 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.708847 Aug 08 16:44:55.410855 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 9/17] 10.222.0.13 () {64 vars in 1283 bytes} [Mon Aug 8 16:44:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:44:55.416321 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-1203fcee-ec04-422a-9b06-a115d661e051 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:44:55.518649 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-1203fcee-ec04-422a-9b06-a115d661e051 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106947 Aug 08 16:44:55.524797 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 9/18] 10.222.0.13 () {64 vars in 1336 bytes} [Mon Aug 8 16:44:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:44:57.967058 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-fe7c676d-59c7-4aae-8b1b-6bc2257a1365 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:44:57.968062 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-fe7c676d-59c7-4aae-8b1b-6bc2257a1365 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 08 16:44:57.968466 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 10/19] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:44:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:44:58.444798 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-d6c967c2-e8e7-4b41-9383-e043e8472360 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:44:58.471517 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-d6c967c2-e8e7-4b41-9383-e043e8472360 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.496321 Aug 08 16:44:58.472104 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 10/20] 10.222.0.13 () {60 vars in 1292 bytes} [Mon Aug 8 16:44:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:45:00.830551 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-fe7c676d-59c7-4aae-8b1b-6bc2257a1365 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:00.831842 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-fe7c676d-59c7-4aae-8b1b-6bc2257a1365 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001770 Aug 08 16:45:00.832324 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:45:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:45:01.336573 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-0818ad36-8ce1-4cf2-9602-5dae1cbf9868 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "disk": 1}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:01.432409 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-0818ad36-8ce1-4cf2-9602-5dae1cbf9868 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.592272 Aug 08 16:45:01.432972 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 11/22] 10.222.0.13 () {64 vars in 1283 bytes} [Mon Aug 8 16:45:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 16:45:01.445881 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-861a92ce-0409-4afc-8164-52f8b1121191 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:01.544256 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-861a92ce-0409-4afc-8164-52f8b1121191 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102265 Aug 08 16:45:01.544889 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 12/23] 10.222.0.13 () {64 vars in 1333 bytes} [Mon Aug 8 16:45:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:45:03.807882 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-0818ad36-8ce1-4cf2-9602-5dae1cbf9868 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:03.809052 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-0818ad36-8ce1-4cf2-9602-5dae1cbf9868 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 08 16:45:03.809456 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:45:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:45:04.243044 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-874a5c57-df40-429a-9fc0-4dc180153abd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "swap": 0, "ram": 2048, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:04.346450 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-874a5c57-df40-429a-9fc0-4dc180153abd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.529492 Aug 08 16:45:04.347863 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 13/25] 10.222.0.13 () {64 vars in 1283 bytes} [Mon Aug 8 16:45:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:45:04.365068 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-30fb28d8-552c-4745-a73b-dcd5a5180e95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:04.448738 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-30fb28d8-552c-4745-a73b-dcd5a5180e95 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087524 Aug 08 16:45:04.449338 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 13/26] 10.222.0.13 () {64 vars in 1333 bytes} [Mon Aug 8 16:45:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:45:06.813043 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-874a5c57-df40-429a-9fc0-4dc180153abd admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:06.814128 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-874a5c57-df40-429a-9fc0-4dc180153abd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001841 Aug 08 16:45:06.814530 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:45:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:45:07.411938 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-22f6ea17-0c85-49a7-8e38-63d79fb6cad7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:07.542556 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-22f6ea17-0c85-49a7-8e38-63d79fb6cad7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.721147 Aug 08 16:45:07.555764 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 14/28] 10.222.0.13 () {64 vars in 1283 bytes} [Mon Aug 8 16:45:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:45:07.565026 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-3f7f7279-5680-49da-aa29-f3340cf9a716 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:07.573538 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG dbcounter [-] [115752] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=115752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:45:07.652758 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-3f7f7279-5680-49da-aa29-f3340cf9a716 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094036 Aug 08 16:45:07.653347 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 15/29] 10.222.0.13 () {64 vars in 1333 bytes} [Mon Aug 8 16:45:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:45:10.059483 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-22f6ea17-0c85-49a7-8e38-63d79fb6cad7 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:10.059483 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-22f6ea17-0c85-49a7-8e38-63d79fb6cad7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001645 Aug 08 16:45:10.059483 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:45:10.578113 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-95794cae-554d-430d-b506-2c95a1c4a040 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "disk": 80}} {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:10.668576 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-95794cae-554d-430d-b506-2c95a1c4a040 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.604785 Aug 08 16:45:10.668576 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 16/31] 10.222.0.13 () {64 vars in 1283 bytes} [Mon Aug 8 16:45:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:45:10.684667 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-d1e75a52-2a6b-4cc6-bded-2ac1b4e67ba2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:10.791462 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-d1e75a52-2a6b-4cc6-bded-2ac1b4e67ba2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111677 Aug 08 16:45:10.792051 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 16/32] 10.222.0.13 () {64 vars in 1333 bytes} [Mon Aug 8 16:45:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:45:13.097820 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-95794cae-554d-430d-b506-2c95a1c4a040 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:13.098920 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-95794cae-554d-430d-b506-2c95a1c4a040 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 08 16:45:13.099252 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:45:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:45:13.704575 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-4b547218-8770-472d-8399-84c2b8773b4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:13.803472 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-4b547218-8770-472d-8399-84c2b8773b4e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.697797 Aug 08 16:45:13.804531 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 17/34] 10.222.0.13 () {64 vars in 1283 bytes} [Mon Aug 8 16:45:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:45:13.816945 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-4050647b-31d5-48bf-b9da-72ba755b6df1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:13.910183 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-4050647b-31d5-48bf-b9da-72ba755b6df1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096996 Aug 08 16:45:13.910801 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 18/35] 10.222.0.13 () {64 vars in 1333 bytes} [Mon Aug 8 16:45:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:45:33.589686 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-4b547218-8770-472d-8399-84c2b8773b4e admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:33.590789 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-4b547218-8770-472d-8399-84c2b8773b4e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 08 16:45:33.591191 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:45:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:45:33.602140 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG dbcounter [-] [115752] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=115752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:45:34.081652 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-8ae20094-b8f3-47b1-82f8-f51b217aedd7 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:34.101543 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-8ae20094-b8f3-47b1-82f8-f51b217aedd7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.503827 Aug 08 16:45:34.102203 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1292 bytes} [Mon Aug 8 16:45:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:45:35.264527 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-4b547218-8770-472d-8399-84c2b8773b4e admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:35.265621 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-4b547218-8770-472d-8399-84c2b8773b4e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Aug 08 16:45:35.266105 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Aug 8 16:45:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:45:35.870098 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-a13f3b00-74d7-4f2f-aca8-a939d0b7e73a admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:35.876980 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.wsgi [None req-a13f3b00-74d7-4f2f-aca8-a939d0b7e73a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-a13f3b00-74d7-4f2f-aca8-a939d0b7e73a admin admin] Request method failure captured: Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Accept: application/json Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Accept-Encoding: gzip, deflate Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Connection: keep-alive Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Content-Length: 0 Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Host: 10.222.0.13 Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Openstack-Api-Version: compute 2.90 Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Openstack-System-Scope: None Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: User-Agent: python-novaclient Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Auth-Token: gAAAAABi8T2vcwBcS18rWMyfSYzIkQsoGMIXoixYh6Uz1p5Gcy90u7LAZ1MFBJrL8p5keqfWqUXT3KQC4tOth5JnlI0cyrLXI6DMS_KexhfWG95Sa__22uSGiZw9JGb28gGh9GbZhL63d1OSsMcOGcufosuE6S4naWwYWMcFkCzlh3oeDfMoJno Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Domain-Id: None Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Domain-Name: None Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Identity-Status: Confirmed Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Is-Admin-Project: True Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Project-Domain-Id: default Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Project-Domain-Name: Default Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Project-Id: 3a8d1eb28476411285e5ac5c0ab9ab53 Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Project-Name: admin Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Role: reader,member,admin Aug 08 16:45:35.880367 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Roles: reader,member,admin Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3a8d1eb28476411285e5ac5c0ab9ab53", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Tenant: admin Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Tenant-Id: 3a8d1eb28476411285e5ac5c0ab9ab53 Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Tenant-Name: admin Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User: admin Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User-Domain-Id: default Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User-Domain-Name: Default Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User-Id: b308731f39014d7098d27d547158b386 Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User-Name: admin Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: method: > Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: exception: Flavor 42 could not be found. Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: action_args: {'id': '42'} Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:45:35.885655 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:45:35.886722 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:35.887883 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-a13f3b00-74d7-4f2f-aca8-a939d0b7e73a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:45:35.889009 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-a13f3b00-74d7-4f2f-aca8-a939d0b7e73a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.476477 Aug 08 16:45:35.889009 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 20/39] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Aug 8 16:45:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 478 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 16:45:35.896673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-0d2f8453-8c3e-4b8c-bf31-b9e6d49fadb4 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:35.901299 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:45:35.921899 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-0d2f8453-8c3e-4b8c-bf31-b9e6d49fadb4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029413 Aug 08 16:45:35.922504 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Aug 8 16:45:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:45:35.937399 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-88752bb6-5177-4952-9662-a360febd5ec8 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:35.965796 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-88752bb6-5177-4952-9662-a360febd5ec8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033149 Aug 08 16:45:35.966497 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Aug 8 16:45:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:45:35.976871 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-43250556-836a-4253-af7c-4a162913c80a admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:35.983583 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.wsgi [None req-43250556-836a-4253-af7c-4a162913c80a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-43250556-836a-4253-af7c-4a162913c80a admin admin] Request method failure captured: Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Accept: application/json Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Accept-Encoding: gzip, deflate Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Connection: keep-alive Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Content-Length: 0 Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Host: 10.222.0.13 Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Openstack-Api-Version: compute 2.90 Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Openstack-System-Scope: None Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: User-Agent: python-novaclient Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Auth-Token: gAAAAABi8T2vcwBcS18rWMyfSYzIkQsoGMIXoixYh6Uz1p5Gcy90u7LAZ1MFBJrL8p5keqfWqUXT3KQC4tOth5JnlI0cyrLXI6DMS_KexhfWG95Sa__22uSGiZw9JGb28gGh9GbZhL63d1OSsMcOGcufosuE6S4naWwYWMcFkCzlh3oeDfMoJno Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Domain-Id: None Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Domain-Name: None Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Identity-Status: Confirmed Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Is-Admin-Project: True Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Project-Domain-Id: default Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Project-Domain-Name: Default Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Project-Id: 3a8d1eb28476411285e5ac5c0ab9ab53 Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Project-Name: admin Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Role: reader,member,admin Aug 08 16:45:35.987139 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Roles: reader,member,admin Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3a8d1eb28476411285e5ac5c0ab9ab53", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Tenant: admin Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Tenant-Id: 3a8d1eb28476411285e5ac5c0ab9ab53 Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Tenant-Name: admin Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User: admin Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User-Domain-Id: default Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User-Domain-Name: Default Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User-Id: b308731f39014d7098d27d547158b386 Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User-Name: admin Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: method: > Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: exception: Flavor 42 could not be found. Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: action_args: {'id': '42'} Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:45:35.992990 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:45:35.993836 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:35.994954 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-43250556-836a-4253-af7c-4a162913c80a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:45:35.996326 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-43250556-836a-4253-af7c-4a162913c80a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015767 Aug 08 16:45:35.996326 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 21/42] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Aug 8 16:45:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 16:45:37.165495 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-88752bb6-5177-4952-9662-a360febd5ec8 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:37.166747 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-88752bb6-5177-4952-9662-a360febd5ec8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001854 Aug 08 16:45:37.167224 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Aug 8 16:45:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:45:37.772666 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-101a9292-e530-4670-a2ac-84b30331b57d admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:37.778398 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.wsgi [None req-101a9292-e530-4670-a2ac-84b30331b57d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-101a9292-e530-4670-a2ac-84b30331b57d admin admin] Request method failure captured: Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Accept: application/json Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Accept-Encoding: gzip, deflate Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Connection: keep-alive Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Content-Length: 0 Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Host: 10.222.0.13 Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Openstack-Api-Version: compute 2.90 Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Openstack-System-Scope: None Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: User-Agent: python-novaclient Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Auth-Token: gAAAAABi8T2xdRyZy5dFi_JW1Pb7vEc25SczcjsRQ4qEfU6PvUHW4C7IB7nNxHwmMw6w7RatwoXBAi9ktI3FUw14JRzxsxCa8JU2NeoZyyZgwysd9pKHyhVJRIahCuJRU36-Uq3w7x067vAcN893AL0NLeLL_Icu6NrPlWvOz9z6N_rguFst5OE Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Domain-Id: None Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Domain-Name: None Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Identity-Status: Confirmed Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Is-Admin-Project: True Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Project-Domain-Id: default Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Project-Domain-Name: Default Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Project-Id: 3a8d1eb28476411285e5ac5c0ab9ab53 Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Project-Name: admin Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Role: reader,member,admin Aug 08 16:45:37.779989 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Roles: reader,member,admin Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3a8d1eb28476411285e5ac5c0ab9ab53", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Tenant: admin Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Tenant-Id: 3a8d1eb28476411285e5ac5c0ab9ab53 Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Tenant-Name: admin Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User: admin Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User-Domain-Id: default Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User-Domain-Name: Default Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User-Id: b308731f39014d7098d27d547158b386 Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User-Name: admin Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: method: > Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: exception: Flavor 84 could not be found. Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: action_args: {'id': '84'} Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:45:37.781772 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:45:37.782957 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:37.784933 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-101a9292-e530-4670-a2ac-84b30331b57d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:45:37.786905 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-101a9292-e530-4670-a2ac-84b30331b57d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.468093 Aug 08 16:45:37.786905 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Aug 8 16:45:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 469 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 08 16:45:37.792263 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-553cd3ab-ee30-4e54-b44e-866a099cbc70 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:37.809504 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-553cd3ab-ee30-4e54-b44e-866a099cbc70 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020800 Aug 08 16:45:37.810081 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Aug 8 16:45:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:45:37.822824 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-9f485714-1b48-4830-95e0-f32b7ddddfd7 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:37.841482 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-9f485714-1b48-4830-95e0-f32b7ddddfd7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022182 Aug 08 16:45:37.842073 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Aug 8 16:45:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:45:37.855636 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-80363ce8-cd33-419b-b1ea-f07fca98b081 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:37.861231 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.wsgi [None req-80363ce8-cd33-419b-b1ea-f07fca98b081 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-80363ce8-cd33-419b-b1ea-f07fca98b081 admin admin] Request method failure captured: Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Accept: application/json Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Accept-Encoding: gzip, deflate Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Connection: keep-alive Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Content-Length: 0 Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Host: 10.222.0.13 Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Openstack-Api-Version: compute 2.90 Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Openstack-System-Scope: None Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: User-Agent: python-novaclient Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Auth-Token: gAAAAABi8T2xdRyZy5dFi_JW1Pb7vEc25SczcjsRQ4qEfU6PvUHW4C7IB7nNxHwmMw6w7RatwoXBAi9ktI3FUw14JRzxsxCa8JU2NeoZyyZgwysd9pKHyhVJRIahCuJRU36-Uq3w7x067vAcN893AL0NLeLL_Icu6NrPlWvOz9z6N_rguFst5OE Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Domain-Id: None Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Domain-Name: None Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Identity-Status: Confirmed Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Is-Admin-Project: True Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Project-Domain-Id: default Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Project-Domain-Name: Default Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Project-Id: 3a8d1eb28476411285e5ac5c0ab9ab53 Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Project-Name: admin Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Role: reader,member,admin Aug 08 16:45:37.862818 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Roles: reader,member,admin Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3a8d1eb28476411285e5ac5c0ab9ab53", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Tenant: admin Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Tenant-Id: 3a8d1eb28476411285e5ac5c0ab9ab53 Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Tenant-Name: admin Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User: admin Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User-Domain-Id: default Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User-Domain-Name: Default Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User-Id: b308731f39014d7098d27d547158b386 Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User-Name: admin Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: method: > Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: exception: Flavor 84 could not be found. Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: action_args: {'id': '84'} Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:45:37.865402 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:45:37.867719 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:37.870050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-80363ce8-cd33-419b-b1ea-f07fca98b081 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:45:37.872269 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-80363ce8-cd33-419b-b1ea-f07fca98b081 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012889 Aug 08 16:45:37.872269 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 24/47] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Aug 8 16:45:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 08 16:45:38.957921 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-9f485714-1b48-4830-95e0-f32b7ddddfd7 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:38.959578 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-9f485714-1b48-4830-95e0-f32b7ddddfd7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 08 16:45:38.962607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 24/48] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Aug 8 16:45:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:45:39.560331 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-569c640b-7737-484b-acf8-55ba9458d2fa admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:39.566899 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.wsgi [None req-569c640b-7737-484b-acf8-55ba9458d2fa admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-569c640b-7737-484b-acf8-55ba9458d2fa admin admin] Request method failure captured: Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Accept: application/json Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Accept-Encoding: gzip, deflate Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Connection: keep-alive Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Content-Length: 0 Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Host: 10.222.0.13 Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Openstack-Api-Version: compute 2.90 Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Openstack-System-Scope: None Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: User-Agent: python-novaclient Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Auth-Token: gAAAAABi8T2yatAhV6DIiYH74UPgBS1Yvl95Sdo01Q9exZYtmSgxVRI-2O_bqBMY_1GYxFcmpRBmT-MWL4AToUiAy0tjSPC2vsQkVEfFDhx5SQWXBwjleLCdj_JeMJ3Ok4T-jiNql3jUmQFqb-P_36OUMLD5B8j0GH4p3fs3FJk3991d5o5dXtA Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Domain-Id: None Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Domain-Name: None Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Identity-Status: Confirmed Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Is-Admin-Project: True Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Project-Domain-Id: default Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Project-Domain-Name: Default Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Project-Id: 3a8d1eb28476411285e5ac5c0ab9ab53 Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Project-Name: admin Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Role: reader,member,admin Aug 08 16:45:39.568603 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Roles: reader,member,admin Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3a8d1eb28476411285e5ac5c0ab9ab53", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Tenant: admin Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Tenant-Id: 3a8d1eb28476411285e5ac5c0ab9ab53 Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-Tenant-Name: admin Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User: admin Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User-Domain-Id: default Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User-Domain-Name: Default Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User-Id: b308731f39014d7098d27d547158b386 Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: X-User-Name: admin Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: method: > Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: exception: Flavor 451 could not be found. Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: action_args: {'id': '451'} Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:45:39.571293 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:45:39.573071 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: ERROR nova.api.openstack.wsgi Aug 08 16:45:39.575046 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-569c640b-7737-484b-acf8-55ba9458d2fa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:45:39.576888 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-569c640b-7737-484b-acf8-55ba9458d2fa admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.464447 Aug 08 16:45:39.576888 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 25/49] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Aug 8 16:45:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 466 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 16:45:39.583319 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-b78bcd4e-7636-4ed7-b647-1b4199993efa admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:39.602017 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-b78bcd4e-7636-4ed7-b647-1b4199993efa admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022821 Aug 08 16:45:39.602647 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Aug 8 16:45:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:45:39.617295 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:39.645475 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035510 Aug 08 16:45:39.646442 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 26/51] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Aug 8 16:45:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:45:39.659308 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-bd9217d7-4b0e-4d91-a9c2-1237fd2a2228 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:39.666169 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.wsgi [None req-bd9217d7-4b0e-4d91-a9c2-1237fd2a2228 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-bd9217d7-4b0e-4d91-a9c2-1237fd2a2228 admin admin] Request method failure captured: Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Accept: application/json Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Accept-Encoding: gzip, deflate Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Connection: keep-alive Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Content-Length: 0 Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Host: 10.222.0.13 Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Openstack-Api-Version: compute 2.90 Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Openstack-System-Scope: None Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: User-Agent: python-novaclient Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Auth-Token: gAAAAABi8T2yatAhV6DIiYH74UPgBS1Yvl95Sdo01Q9exZYtmSgxVRI-2O_bqBMY_1GYxFcmpRBmT-MWL4AToUiAy0tjSPC2vsQkVEfFDhx5SQWXBwjleLCdj_JeMJ3Ok4T-jiNql3jUmQFqb-P_36OUMLD5B8j0GH4p3fs3FJk3991d5o5dXtA Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Domain-Id: None Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Domain-Name: None Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Identity-Status: Confirmed Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Is-Admin-Project: True Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Project-Domain-Id: default Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Project-Domain-Name: Default Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Project-Id: 3a8d1eb28476411285e5ac5c0ab9ab53 Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Project-Name: admin Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Role: reader,member,admin Aug 08 16:45:39.667672 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Roles: reader,member,admin Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3a8d1eb28476411285e5ac5c0ab9ab53", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3a8d1eb28476411285e5ac5c0ab9ab53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Tenant: admin Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Tenant-Id: 3a8d1eb28476411285e5ac5c0ab9ab53 Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-Tenant-Name: admin Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User: admin Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User-Domain-Id: default Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User-Domain-Name: Default Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User-Id: b308731f39014d7098d27d547158b386 Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: X-User-Name: admin Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: method: > Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: exception: Flavor 451 could not be found. Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: action_args: {'id': '451'} Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:45:39.670120 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:45:39.671673 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: ERROR nova.api.openstack.wsgi Aug 08 16:45:39.673607 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-bd9217d7-4b0e-4d91-a9c2-1237fd2a2228 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:45:39.675491 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-bd9217d7-4b0e-4d91-a9c2-1237fd2a2228 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013546 Aug 08 16:45:39.675491 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Aug 8 16:45:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 16:45:40.708806 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:40.710229 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Aug 08 16:45:40.710664 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Aug 8 16:45:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:45:41.425579 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-a5479570-d825-4398-b469-a70a3b167c19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:41.504208 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-a5479570-d825-4398-b469-a70a3b167c19 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.649683 Aug 08 16:45:41.504787 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 27/54] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Aug 8 16:45:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:45:42.541993 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:42.543050 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 08 16:45:42.543452 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Aug 8 16:45:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:45:43.147064 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-1bef5b3e-1605-41fe-a41d-9eb5b29fdce2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:43.232092 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-1bef5b3e-1605-41fe-a41d-9eb5b29fdce2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.548731 Aug 08 16:45:43.232578 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 28/56] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Aug 8 16:45:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:45:44.261545 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:44.262922 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Aug 08 16:45:44.263528 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Aug 8 16:45:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:45:44.832879 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-16af53cc-66eb-4062-b27e-49056d86445b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:44.946223 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-16af53cc-66eb-4062-b27e-49056d86445b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.540240 Aug 08 16:45:44.946823 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 29/58] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Aug 8 16:45:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:45:45.954193 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:45.957433 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003663 Aug 08 16:45:45.957861 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 30/59] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Aug 8 16:45:45 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:45:46.538971 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-e358d44f-f030-4357-901f-3661e8a73fd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:45:46.607553 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-e358d44f-f030-4357-901f-3661e8a73fd8 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.505805 Aug 08 16:45:46.608113 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 30/60] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Aug 8 16:45:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:45:47.636416 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:47.637432 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 08 16:45:47.637849 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 31/61] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Aug 8 16:45:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:45:48.226325 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-026964f2-fc62-4872-a04d-005796d2b958 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:45:48.248511 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-026964f2-fc62-4872-a04d-005796d2b958 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.467094 Aug 08 16:45:48.249061 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 31/62] 10.222.0.13 () {60 vars in 1202 bytes} [Mon Aug 8 16:45:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:46:42.824648 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:46:42.825672 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-9795ab46-8e42-4729-a281-4f1d8e6d3aac admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 Aug 08 16:46:42.826078 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 931 bytes} [Mon Aug 8 16:46:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:46:42.837860 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:46:43.241720 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-45388d86-7f31-4ca8-9b04-2b5cfacd3697 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:46:43.263009 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-45388d86-7f31-4ca8-9b04-2b5cfacd3697 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.429883 Aug 08 16:46:43.263558 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 32/64] 10.222.0.13 () {60 vars in 1292 bytes} [Mon Aug 8 16:46:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:46:43.285903 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG dbcounter [-] [115752] Writing DB stats nova_api:SELECT=14 {{(pid=115752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:46:43.289680 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-d17c2e6e-687f-47e7-95d8-4c832c80eb71 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:46:43.297503 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-d17c2e6e-687f-47e7-95d8-4c832c80eb71 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013193 Aug 08 16:46:43.298051 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 33/65] 10.222.0.13 () {60 vars in 1283 bytes} [Mon Aug 8 16:46:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:46:43.310514 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-7de67b9d-3e5a-4210-b0ae-3a799ed00652 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:46:43.318986 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-7de67b9d-3e5a-4210-b0ae-3a799ed00652 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012277 Aug 08 16:46:43.319521 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 33/66] 10.222.0.13 () {60 vars in 1286 bytes} [Mon Aug 8 16:46:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:46:43.331701 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-938fca30-941c-4e33-a1d7-dec915062613 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:46:43.340798 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-938fca30-941c-4e33-a1d7-dec915062613 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012901 Aug 08 16:46:43.341344 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 34/67] 10.222.0.13 () {60 vars in 1286 bytes} [Mon Aug 8 16:46:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:46:43.353328 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-7d1d916b-6aa7-4dd8-94a8-09b209c015b8 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:46:43.360991 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-7d1d916b-6aa7-4dd8-94a8-09b209c015b8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011281 Aug 08 16:46:43.361520 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 34/68] 10.222.0.13 () {60 vars in 1283 bytes} [Mon Aug 8 16:46:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:49:50.331576 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-938fca30-941c-4e33-a1d7-dec915062613 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:49:50.332567 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-938fca30-941c-4e33-a1d7-dec915062613 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 08 16:49:50.332964 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Aug 8 16:49:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:49:50.473226 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writing DB stats nova_api:SELECT=6 {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:49:50.635048 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-ca82f472-f7bc-43d9-882f-703e922ea229 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:49:50.637373 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:49:50.637373 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: warnings.warn(msg) Aug 08 16:49:50.638496 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-ca82f472-f7bc-43d9-882f-703e922ea229 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:49:50.639026 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-ca82f472-f7bc-43d9-882f-703e922ea229 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:49:50.639450 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-ca82f472-f7bc-43d9-882f-703e922ea229 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:49:50.640303 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-ca82f472-f7bc-43d9-882f-703e922ea229 admin admin] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:49:50.640752 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-ca82f472-f7bc-43d9-882f-703e922ea229 admin admin] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:49:50.641174 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-ca82f472-f7bc-43d9-882f-703e922ea229 admin admin] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:49:50.675723 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-ca82f472-f7bc-43d9-882f-703e922ea229 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204068 Aug 08 16:49:50.676291 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 35/70] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Aug 8 16:49:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:49:51.510213 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-938fca30-941c-4e33-a1d7-dec915062613 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:49:51.511277 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-938fca30-941c-4e33-a1d7-dec915062613 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 08 16:49:51.511676 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 36/71] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Aug 8 16:49:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:49:51.707228 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-7ce2e95b-dfc5-46c8-96c1-2aae7ad6bc44 admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:49:51.710818 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:49:51.710818 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: warnings.warn(msg) Aug 08 16:49:51.711967 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-7ce2e95b-dfc5-46c8-96c1-2aae7ad6bc44 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:49:51.712440 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-7ce2e95b-dfc5-46c8-96c1-2aae7ad6bc44 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:49:51.712868 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-7ce2e95b-dfc5-46c8-96c1-2aae7ad6bc44 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:49:51.713571 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-7ce2e95b-dfc5-46c8-96c1-2aae7ad6bc44 admin admin] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:49:51.714005 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-7ce2e95b-dfc5-46c8-96c1-2aae7ad6bc44 admin admin] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:49:51.714470 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-7ce2e95b-dfc5-46c8-96c1-2aae7ad6bc44 admin admin] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:49:51.735152 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-7ce2e95b-dfc5-46c8-96c1-2aae7ad6bc44 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081983 Aug 08 16:49:51.735726 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 36/72] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Aug 8 16:49:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 16:50:03.023884 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-938fca30-941c-4e33-a1d7-dec915062613 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:50:03.024874 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-938fca30-941c-4e33-a1d7-dec915062613 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 08 16:50:03.025272 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 37/73] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Aug 8 16:50:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:50:03.168456 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writing DB stats nova_cell0:SELECT=4 {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:50:03.169216 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writing DB stats nova_cell1:SELECT=4 {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:50:03.169839 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG dbcounter [-] [115753] Writing DB stats nova_api:SELECT=8 {{(pid=115753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:50:03.219343 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-8edb1da4-e857-409a-9bcc-054111ff678b admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:50:03.221680 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:50:03.221680 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: warnings.warn(msg) Aug 08 16:50:03.222811 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-8edb1da4-e857-409a-9bcc-054111ff678b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:50:03.223356 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-8edb1da4-e857-409a-9bcc-054111ff678b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:50:03.223710 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-8edb1da4-e857-409a-9bcc-054111ff678b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:50:03.224424 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-8edb1da4-e857-409a-9bcc-054111ff678b admin admin] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:50:03.224873 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-8edb1da4-e857-409a-9bcc-054111ff678b admin admin] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:50:03.225281 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-8edb1da4-e857-409a-9bcc-054111ff678b admin admin] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:50:03.251513 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-8edb1da4-e857-409a-9bcc-054111ff678b admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087376 Aug 08 16:50:03.252003 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 37/74] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Aug 8 16:50:03 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:50:04.090236 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: DEBUG nova.api.openstack.wsgi [None req-938fca30-941c-4e33-a1d7-dec915062613 admin admin] Calling method '>' {{(pid=115752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:50:04.091345 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: INFO nova.api.openstack.requestlog [None req-938fca30-941c-4e33-a1d7-dec915062613 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 08 16:50:04.091667 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: [pid: 115752|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Aug 8 16:50:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:50:04.286022 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG nova.api.openstack.wsgi [None req-70c75205-067a-471e-b986-43a6b70aa7fe admin admin] Calling method '>' {{(pid=115753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:50:04.288447 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 16:50:04.288447 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: warnings.warn(msg) Aug 08 16:50:04.289589 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-70c75205-067a-471e-b986-43a6b70aa7fe admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:50:04.290066 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-70c75205-067a-471e-b986-43a6b70aa7fe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:50:04.290493 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-70c75205-067a-471e-b986-43a6b70aa7fe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:50:04.291225 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-70c75205-067a-471e-b986-43a6b70aa7fe admin admin] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:50:04.291671 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-70c75205-067a-471e-b986-43a6b70aa7fe admin admin] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:50:04.292088 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: DEBUG oslo_concurrency.lockutils [None req-70c75205-067a-471e-b986-43a6b70aa7fe admin admin] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:50:04.313432 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: INFO nova.api.openstack.requestlog [None req-70c75205-067a-471e-b986-43a6b70aa7fe admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081198 Aug 08 16:50:04.313991 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: [pid: 115753|app: 0|req: 38/76] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Aug 8 16:50:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:51:01.685890 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: Mon Aug 8 16:51:01 2022 - graceful shutdown triggered... Aug 08 16:51:01.686154 dv-cinder-852209-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 08 16:51:01.687245 dv-cinder-852209-3-iscsi devstack@n-api.service[115752]: Gracefully killing worker 1 (pid: 115752)... Aug 08 16:51:01.687646 dv-cinder-852209-3-iscsi devstack@n-api.service[115753]: Gracefully killing worker 2 (pid: 115753)... Aug 08 16:51:02.688365 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: worker 1 buried after 1 seconds Aug 08 16:51:02.688365 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: worker 2 buried after 1 seconds Aug 08 16:51:02.689050 dv-cinder-852209-3-iscsi devstack@n-api.service[115750]: goodbye to uWSGI. Aug 08 16:51:02.689966 dv-cinder-852209-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 08 16:51:02.690554 dv-cinder-852209-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 08 16:51:02.693461 dv-cinder-852209-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 16:51:02.705583 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 16:51:02.707694 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 16:51:02 2022] *** Aug 08 16:51:02.707694 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 16:51:02.707694 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 16:51:02.707694 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: nodename: dv-cinder-852209-3-iscsi Aug 08 16:51:02.707694 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: machine: x86_64 Aug 08 16:51:02.707694 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: clock source: unix Aug 08 16:51:02.707694 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: pcre jit disabled Aug 08 16:51:02.707694 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: detected number of CPU cores: 4 Aug 08 16:51:02.707694 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: current working directory: / Aug 08 16:51:02.707694 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: detected binary path: /usr/bin/uwsgi-core Aug 08 16:51:02.707694 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: your processes number limit is 47680 Aug 08 16:51:02.707694 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: your memory page size is 4096 bytes Aug 08 16:51:02.707694 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: detected max file descriptor number: 2048 Aug 08 16:51:02.709126 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: lock engine: pthread robust mutexes Aug 08 16:51:02.709126 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: thunder lock: enabled Aug 08 16:51:02.709126 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 16:51:02.709126 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 16:51:02.750792 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: Python main interpreter initialized at 0x564bfde619c0 Aug 08 16:51:02.750792 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: python threads support enabled Aug 08 16:51:02.750792 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: your server socket listen backlog is limited to 100 connections Aug 08 16:51:02.750792 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: your mercy for graceful operations on workers is 90 seconds Aug 08 16:51:02.751224 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 16:51:02.751224 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: *** Operational MODE: preforking *** Aug 08 16:51:02.751714 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: *** uWSGI is running in multiple interpreter mode *** Aug 08 16:51:02.751714 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: spawned uWSGI master process (pid: 130223) Aug 08 16:51:02.751948 dv-cinder-852209-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 16:51:02.754262 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: spawned uWSGI worker 1 (pid: 130235, cores: 1) Aug 08 16:51:02.754262 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: spawned uWSGI worker 2 (pid: 130236, cores: 1) Aug 08 16:51:02.754262 dv-cinder-852209-3-iscsi devstack@n-api.service[130223]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 16:51:03.441048 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 16:51:03.460390 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 16:51:04.640582 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:51:04.640582 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: from cryptography.utils import int_from_bytes Aug 08 16:51:04.641244 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:51:04.641244 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: from cryptography.utils import int_from_bytes Aug 08 16:51:04.703065 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:51:04.703065 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: from cryptography.utils import int_from_bytes Aug 08 16:51:04.703699 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 16:51:04.703699 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: from cryptography.utils import int_from_bytes Aug 08 16:51:06.998616 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 16:51:06.999156 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 16:51:06.999382 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 16:51:06.999728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 16:51:06.999955 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 16:51:07.000352 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.000681 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.001009 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.001326 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.001662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.001981 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.002305 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.002647 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.002985 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.003247 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.003564 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.003891 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-3-iscsi {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.004218 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.004531 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.004850 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.005170 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.005479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.005804 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.006116 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.006663 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.008131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.008131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.008131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.008438 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.008810 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.009099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.009341 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.009711 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.010095 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.010416 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.010859 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-3-iscsi {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.011193 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.011511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.011820 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.012250 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.012565 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.012874 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.013201 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.013556 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.013856 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.014185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.014511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.014868 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.015195 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.015519 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.015820 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.016135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.016457 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.016767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.017078 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.017419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.017640 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.017971 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.018297 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.018645 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.018896 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.019151 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.019474 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.019803 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.020118 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.020436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.020747 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.021063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.021369 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.021680 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.021988 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.022298 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.022652 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.022978 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.023302 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.023616 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.023938 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.025109 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.025449 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.025769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.026126 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.026452 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.026815 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.027146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.027475 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.027790 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.028102 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.028414 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.028739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.029078 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.029387 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.029642 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.029950 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.030259 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.030618 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.030918 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.031230 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.031539 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.031851 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.032162 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.032451 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.032763 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.033071 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.033378 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.033688 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.034000 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.034311 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.034677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.035006 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.035338 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.035646 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.035958 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.036266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.036577 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.036902 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.037211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.037521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.037845 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.038152 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.038459 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.038805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.039118 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.039428 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.039805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.040592 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.040913 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.041289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.041665 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.041977 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.042289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.042615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.042930 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.043242 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.043551 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.043864 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.044167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.044489 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.044811 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.045128 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.045439 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.045752 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.046071 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.046413 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.046797 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.047149 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.047469 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.047808 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.048146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.048469 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.048788 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.049107 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.049438 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.049753 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.050068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.050381 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.050724 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.051048 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.051382 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.051721 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.052034 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.052349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.052663 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.052982 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.053317 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.053646 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.053962 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.054307 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.054695 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.055019 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.055425 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.055802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.056118 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.056434 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.056751 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.057074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.057409 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.057725 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.058047 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.058363 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.058706 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.059027 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.059342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.059661 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.060004 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.060322 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.060644 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.060961 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.061286 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.061602 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.061917 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.062232 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.062545 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.062877 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.063190 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.063506 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.063819 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.064151 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.064480 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.064792 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.065138 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.065454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.065769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.066090 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.066406 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.066740 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.067058 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.067374 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.067687 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.068013 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.068329 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.068640 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.068967 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.069278 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.070214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.070214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.070214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.070543 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.070937 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.071793 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.072375 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.072375 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.072860 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.073007 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.073348 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.073658 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.073990 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.074346 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.074664 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.074979 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.075293 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.075603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.075912 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.076219 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.076532 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.076841 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.077149 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.077456 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.078010 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.078332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.078667 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.078981 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.079740 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.079740 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.079965 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.080213 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.080518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.080865 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.081205 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.081530 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.081858 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.082173 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.082490 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.082832 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.083146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.083464 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.083784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.083976 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 16:51:07.084457 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.084641 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 16:51:07.084829 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.084829 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.085129 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 16:51:07.085296 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.085448 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 16:51:07.085604 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.085761 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 16:51:07.085971 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.086128 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.086303 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.086463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.086740 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.086930 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.087087 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.087722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.087881 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.088031 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.088031 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.088369 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.088517 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.088713 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.088873 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.089029 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.089190 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.089347 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.089505 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.089660 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.089807 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.089963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.090120 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-3-iscsi {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.090282 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.090433 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.090606 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.091189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.091366 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.091523 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.091671 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.091839 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.092214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.092370 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.092549 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.092702 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.092992 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.093148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.093313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.093313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.093724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.094059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.094225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.094383 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.094530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.094717 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.094868 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.095014 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.095170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.095336 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.095492 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.095647 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.095809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.095956 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.096102 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.096257 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.096404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.096548 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.096707 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.096854 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.097000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.097145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.097292 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-3-iscsi {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.097455 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.097610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.097767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.097923 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.098077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.098240 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.098397 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.098553 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.098751 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.098908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.099064 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.099064 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.099358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.099505 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.099658 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.099813 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.099960 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.100131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.100289 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.100443 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.101530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.101704 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.101864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.102023 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.102423 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.102613 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.102912 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.103083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.103232 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.103396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.103564 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.103740 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.103996 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.104303 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.104476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.104644 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.104801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.104989 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.105148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.105148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.105443 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.105591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.105748 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.105916 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.106064 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.106218 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.106378 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.106526 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.106748 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.106906 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.107063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.107223 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.107384 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.107532 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.107532 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.107532 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.107971 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.108195 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.108344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.108490 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.108643 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.108789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.108936 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.109091 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.109246 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.109392 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.109538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.109711 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.109872 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.110029 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.110195 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.110346 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.110492 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.110659 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.110821 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.110995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.111490 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.111648 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.111803 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.111951 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.112123 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.112272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.112634 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.112798 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.112953 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.113100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.113258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.113405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.113571 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.113803 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.113983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.114239 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.114544 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.114775 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.114775 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.115055 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.115201 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.115366 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.115522 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.115669 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.115831 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.115978 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.116133 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.116290 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.116438 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.116594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.116749 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.116904 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.117080 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.117772 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.117979 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.117979 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.118495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.118749 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.118920 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.119069 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.119216 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.119362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.119535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.119684 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.119837 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.119992 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.120139 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.120300 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.120465 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.120622 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.120778 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.120932 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.121086 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.121595 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.121759 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.121930 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.122085 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.122243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.122399 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.122560 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.122956 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.123110 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.123258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.123405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.123551 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.123709 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.123857 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.124004 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.124188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.124583 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.124743 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.124901 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.124901 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.125197 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.125358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.125358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.125637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.125784 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.125929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.126075 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.126247 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.126406 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.126553 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.126727 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.126876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.127035 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.127183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.127329 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.127475 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.127623 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.127779 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.127937 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.128085 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.128241 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.128387 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.128555 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.129256 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.129434 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.129585 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.130497 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.130693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.130846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.131001 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.131156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.131331 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.131870 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.132036 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.132185 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.132347 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.132590 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.132770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.133193 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.133367 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.134109 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.134277 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.134459 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.134459 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.134931 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.135101 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.135255 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.135255 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.135554 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.135721 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.135890 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.136050 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.136213 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.136374 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.136535 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.136689 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.136852 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 16:51:07.137006 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.137170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.137332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.137485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.137645 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.137816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.137971 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.138131 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.138294 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.138498 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.138712 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.138868 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.139021 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.139187 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.139343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.139497 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.139666 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.139877 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.140045 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.140217 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.140372 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.140535 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.140776 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.140934 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.141088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.141256 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.141426 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.142151 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.142266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.142346 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.142419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.142419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.142560 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.142684 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.142684 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.142818 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.142889 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.142969 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.143042 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.143122 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.143196 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.143267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.143337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.143422 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.143495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.143579 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.143653 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.143723 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.143801 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.143873 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.143952 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.144038 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.144112 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.144197 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.144276 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.144348 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.144427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.144508 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.144587 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.144768 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.144848 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.144929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.145022 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.145104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.145184 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.145265 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.145344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.145424 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.145509 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.145583 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.145703 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.145802 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.145920 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.145920 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.146099 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.146185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.146279 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.146279 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.146428 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.146428 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.146612 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.146612 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.146770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.146850 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.146850 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.146990 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.147064 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.147133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.147203 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.147281 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.147374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.147374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.147374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.147607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.147697 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.147788 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.147788 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.147958 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.148048 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.148132 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.148221 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.148304 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.148399 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.148491 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.148582 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.148672 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.148762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.148845 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.148935 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.149027 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.149141 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.149264 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.149840 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.149934 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.150032 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.150123 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.150212 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.150296 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.150386 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.150477 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.150741 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.150855 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.150951 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.151036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.151119 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.151211 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.151297 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.151379 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.151462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.151551 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.151643 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.151737 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.151826 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.151908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.151982 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.152061 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.152142 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.152240 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.152322 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.152395 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.152620 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.152732 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.152936 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.153041 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.153254 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.153357 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.153573 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.153665 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.153889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.153985 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.154198 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.154299 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.154515 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.154647 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.154883 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.154985 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.155221 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.155315 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.155537 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.155674 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.156033 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.156144 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.156233 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.156310 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.156562 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.156670 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.156873 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.156981 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.157169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.157276 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.157494 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.157658 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.157805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.157955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.158097 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.158271 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.158419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.159303 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.159303 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.159632 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.159776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.160050 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.160195 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.160351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.160496 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.160640 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.160783 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.160925 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.161067 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.161219 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.161376 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.161519 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.161673 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.161826 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.162152 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.162421 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.162583 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.162680 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.162781 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.162870 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.162960 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.163055 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.163150 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.163243 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.163338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.163433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.163537 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.163633 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.163720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.163805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.163889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.163987 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.164082 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.164180 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.164275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.164478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.164582 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.165366 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.165472 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.165744 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.165841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.166060 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.166184 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.166373 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.166503 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.166815 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.166916 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.167014 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.167171 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.167346 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.167491 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.167661 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.167817 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.167984 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.168134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.168302 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.168467 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.168634 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.168785 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.168968 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.169112 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.169287 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.169423 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.169615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.169793 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.169947 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.170105 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.170248 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.170433 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.170639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.170787 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.170964 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.171301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.171741 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.171969 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.172071 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.172297 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.172394 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.172623 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.172720 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.172939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.173034 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.173260 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.173358 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.173580 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.173665 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.173899 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.173989 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.174213 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.174383 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.174527 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.174659 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.174879 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.174971 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.175188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.175285 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.175517 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.175624 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.175827 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.175920 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.176167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.176272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.176568 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.176674 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.176771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.176850 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.177080 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.177176 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.177366 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.177452 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.177860 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.177967 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.178058 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.178147 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.178333 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.178444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.178768 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.178882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.178991 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.179084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.179297 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.179388 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.179614 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.179718 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.179927 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.180026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.180240 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.180439 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.181148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.181260 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.181546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.181652 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.181789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.181893 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.182144 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.182251 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.182489 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.182731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.182833 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.182921 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.183212 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.183322 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.183504 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.183627 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.183839 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.183949 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.184147 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.184259 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.184461 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.184554 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.184791 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.184890 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.185105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.185206 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.185412 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.185512 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.185724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.185807 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.186030 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.186138 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.186346 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.186450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.186677 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.186783 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.186990 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.187091 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.187333 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.187440 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.187603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.187759 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.187911 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.188004 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.188241 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.188333 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.188565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.188852 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.188952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.189184 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.189322 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.189502 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.189599 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.189814 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.189910 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.190121 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.190214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.190430 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.190533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.190784 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.190881 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.191100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.191204 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.191426 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.191571 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.191736 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.191838 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.192056 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.192150 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.192372 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.192513 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.192693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.192831 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.193047 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.193151 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.193313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.193421 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.193627 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.193727 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.193934 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.194033 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.194249 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.194350 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.194584 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.194680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.194906 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.195182 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.195283 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.195521 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.195615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.195843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.196094 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.196191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.196435 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.196533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.196758 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.196858 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.197089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.197271 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.197475 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.197646 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.197804 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.197959 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.198107 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.198271 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.198433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.198631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.198778 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.198957 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.199163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.199321 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.199516 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.200114 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.200204 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.200294 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.200482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.200598 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.200888 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.200998 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.201280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.201399 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.201497 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.201790 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.201867 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.201940 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.202126 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.202221 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.202435 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.203003 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.203287 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.203516 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.203658 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.203971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.204076 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.204306 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.204398 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.204624 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.204794 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.204936 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.205027 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.205247 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.205330 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.205559 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.205650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.205959 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.206054 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.206205 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.206555 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.207046 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.207138 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.207396 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.207487 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.207733 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.207830 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.209466 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.209586 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.209677 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.209772 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.209867 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.209963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.210049 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.210049 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.210223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.210318 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.210412 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.210510 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.210635 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.210723 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.210809 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.210892 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.210972 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.211054 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.211127 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.211214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.211296 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.211477 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.211954 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.212053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.212272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.212368 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.212442 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.212617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.212951 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.213052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.213279 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.213470 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.213624 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.213790 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.213884 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.214032 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.214182 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.214328 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.214480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.214658 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.214808 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.214906 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.215127 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.215224 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.215436 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.215540 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.215760 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.215860 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.216129 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.216898 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.217593 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.217677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.217751 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.217824 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.217905 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.217987 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.218071 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.218147 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.218227 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.218309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.218393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.218765 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.218877 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.218877 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.219033 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.219116 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.219202 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.219306 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.219386 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.219460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.219532 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.219847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.219926 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.220017 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.220102 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.220297 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.220410 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.220625 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.220753 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.220931 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.221018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.221246 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.221345 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.221554 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.221646 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.231922 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.232062 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.232062 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.232240 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.232328 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.232417 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.232509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.232624 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.232775 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.232867 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.232958 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.233074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.233164 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.233249 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.233334 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.233428 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.233515 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.233610 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.233687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.233760 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.233831 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.233910 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.233990 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.234086 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.234173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.234266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.234266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.234424 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.234522 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.234640 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.234727 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.234813 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.234907 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.235002 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.235173 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.235413 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.235413 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.235584 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.235584 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.235746 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.235847 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.235949 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.236038 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.236836 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.236947 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.237044 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.237146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.237242 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.237338 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.237422 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.237422 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.237566 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.237641 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.237715 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.237795 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.237870 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.237950 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.238039 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.238122 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.238198 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.238271 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.238343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.238416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.238498 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.238669 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.238768 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.238846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.238846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.238986 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.239070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.239146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.239218 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.239299 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.239375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.239462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.239544 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.239619 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.239691 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.239770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.239907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240001 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240184 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240259 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240331 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240402 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240493 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240575 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240656 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240739 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240820 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240901 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240987 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240987 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240987 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.240987 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.241269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.241352 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.241434 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.241508 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.241581 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.241660 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.241735 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.241817 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.241891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.241965 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.242036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.242108 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.242187 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.242270 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.242358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.242440 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.242522 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.242642 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.242894 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.242979 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.243061 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.243136 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.243209 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.243280 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.243433 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.243518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.243600 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.243682 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.243765 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.243840 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.243921 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.244004 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.244079 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.244152 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.244224 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.244297 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.244379 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.244463 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.244538 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.244611 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.244691 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.244780 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.244855 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.244928 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.245009 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.245083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.245157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.245242 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.245544 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.245650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.245735 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.245835 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.246036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.246221 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.246506 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.246662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.246744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.246826 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.247009 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.247113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.247335 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.247440 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.247664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.247770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.248057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.248152 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.248388 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.248486 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.248753 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.248854 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.249015 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.249134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.249327 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.249459 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.249634 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.249759 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.249946 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.250075 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.250268 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.250404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.250601 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.250784 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.250917 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.251111 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.251225 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.251437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.251555 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.251754 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.251861 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.252084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.252259 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.252415 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.252515 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.253000 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.253091 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.253165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.253236 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.253320 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.253404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.253603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.253716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.253906 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.254008 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.254211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.254314 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.254517 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.254648 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.254894 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.255057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.255206 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.255388 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.255511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.256521 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.256635 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.256741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.256826 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.256973 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.257087 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.257175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.257266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.257387 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.257552 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.257631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.257712 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.257829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.257906 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.257978 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.258059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.258242 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.258344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.259208 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.259407 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.259707 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.259903 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.260049 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.260503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.260614 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.260699 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.260793 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.260894 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.261023 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.261197 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.261291 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.261541 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.261644 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.261861 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.261956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.262179 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.262273 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.262495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.262623 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.262841 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.262943 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.263155 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.263249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.263469 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.263573 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.263801 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.263900 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.264113 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.264214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.264427 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.264535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.264738 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.264830 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.265064 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.265164 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.265388 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.265488 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.265704 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.265795 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.266029 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.266162 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.266435 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.266679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.266679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.266865 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.267007 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.267163 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.267321 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.267460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.267623 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.267779 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.267921 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.268071 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.268240 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.268500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.268652 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.268792 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.268939 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.269093 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.269234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.269374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.269522 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.269661 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.269812 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.269961 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.270100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.270240 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.270380 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.270528 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.270696 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.270981 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.271162 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.271292 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.271501 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.271604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.271858 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.271966 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.272178 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.272271 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.272527 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.272608 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.272853 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.273049 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.273161 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.273253 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.273528 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.273646 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.273755 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.273857 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.274002 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130236) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 16:51:07.274806 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.275011 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.275326 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.275658 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.275986 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.276314 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.276636 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.276960 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.277281 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.277605 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.277928 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.278246 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.278591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.278931 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.279280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.279888 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.281069 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.281420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.281749 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.282078 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.282407 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.282833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.283126 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.283423 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.283760 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.284048 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.284397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.284732 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.285069 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.285537 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.285856 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.286074 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.286403 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.286912 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.287397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.287601 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.287919 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.288243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.288574 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.288893 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.289207 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.289526 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.289879 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.290200 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.290524 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.290999 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.291317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.291641 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.292004 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.292317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.292656 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.292992 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.293299 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.293621 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.294212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.294541 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.294918 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.295255 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.295715 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.296054 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.296251 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.296596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.296909 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.297227 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.297656 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.297868 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.298178 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.298514 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.298863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.299176 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.299503 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.299821 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.300414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.300774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.301100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.301434 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.301766 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.302088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.302400 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.302764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.303079 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.303395 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.303719 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.304039 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.304350 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.304665 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.304985 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.305327 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.305869 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.306286 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.306782 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.306981 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.307298 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.307693 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.307925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.308246 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.308559 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.308872 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.309189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.309502 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.309823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.310134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.310453 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.310802 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.311123 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.311450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.311782 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.312094 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.312560 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.312755 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.313797 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.313797 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.313797 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.314065 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.314539 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.314721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.315084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.315721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.316022 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.316360 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.316690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.317159 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.317391 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.317705 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.318017 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.318328 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.318937 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.319250 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.319452 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.319774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.320088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.320404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.320725 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.321577 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.321899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.322221 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.322535 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.322874 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.323196 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.323512 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.323826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.324151 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.324513 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.324841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.325166 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.325488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.325810 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.326128 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.326443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.326910 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.327112 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.327436 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.328103 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.328344 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.328656 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.329104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.329443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.329747 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.330076 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.330391 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.330800 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.331076 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.331394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.331722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.332038 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.332374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.332723 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.333063 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.333393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.333706 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.334016 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.334325 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.334677 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.335006 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.335321 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.335629 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.335940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.336256 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.336591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.337535 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.337743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.338053 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.338477 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.338682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.338980 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.339291 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.339637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.339901 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.340215 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.340530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.340950 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.341152 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.341459 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.343325 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.343325 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.343325 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.343325 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.343325 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.344305 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.344305 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.344305 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.344305 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.344661 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.344957 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.345282 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.345598 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.345941 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.346256 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.346613 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.346914 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.347233 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.347561 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.348021 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.348197 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.348752 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.349066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.349168 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.349481 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.349823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.350095 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.350416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.350788 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.351107 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.351424 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.351744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.352059 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.352408 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.352784 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.353040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.353444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.353647 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.353963 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.354618 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.354618 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.354993 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.355271 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.355603 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.355963 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.356284 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.356639 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.356973 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.357296 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.357616 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.357929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 16:51:07.358303 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 16:51:07.448598 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO dbcounter [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] Registered counter for database nova_api Aug 08 16:51:07.470960 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_db.sqlalchemy.engines [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:07.479288 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writer thread running {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:07.513140 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO dbcounter [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] Registered counter for database nova_api Aug 08 16:51:07.537361 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_db.sqlalchemy.engines [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:07.541736 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.context [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),24395fe2-62ef-4f67-8fb3-2dbb6cef8108(cell1) {{(pid=130236) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 16:51:07.545853 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writer thread running {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:07.546886 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:51:07.547015 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:51:07.548749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:51:07.549694 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:51:07.550266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:51:07.552468 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:51:07.554997 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO dbcounter [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] Registered counter for database nova_cell0 Aug 08 16:51:07.559707 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO dbcounter [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] Registered counter for database nova_cell1 Aug 08 16:51:07.571609 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_db.sqlalchemy.engines [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:07.572641 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_db.sqlalchemy.engines [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:07.585338 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writer thread running {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:07.592482 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writer thread running {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:07.612021 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.context [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),24395fe2-62ef-4f67-8fb3-2dbb6cef8108(cell1) {{(pid=130235) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 16:51:07.616371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:51:07.616950 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:51:07.618815 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:51:07.619635 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:51:07.620156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:51:07.622229 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:51:07.624557 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO dbcounter [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] Registered counter for database nova_cell0 Aug 08 16:51:07.629348 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO dbcounter [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] Registered counter for database nova_cell1 Aug 08 16:51:07.639615 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_db.sqlalchemy.engines [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:07.640660 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_db.sqlalchemy.engines [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:07.645777 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writer thread running {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:07.746208 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO dbcounter [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] Registered counter for database nova_cell0 Aug 08 16:51:07.753558 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_db.sqlalchemy.engines [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130236) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:07.759385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writer thread running {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:07.813038 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writer thread running {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:07.823871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO dbcounter [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] Registered counter for database nova_cell0 Aug 08 16:51:07.831893 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_db.sqlalchemy.engines [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 16:51:07.837176 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writer thread running {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 16:51:08.089577 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: WARNING keystonemiddleware.auth_token [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:51:08.096958 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: WARNING keystonemiddleware.auth_token [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:51:08.166013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: WARNING keystonemiddleware.auth_token [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:51:08.173383 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: WARNING keystonemiddleware.auth_token [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:51:08.449958 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: WARNING keystonemiddleware.auth_token [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:51:08.456469 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: WARNING keystonemiddleware.auth_token [None req-7deb98eb-5bda-40de-98d7-dff33844fa2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:51:08.463453 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564bfde619c0 pid: 130236 (default app) Aug 08 16:51:08.517084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: WARNING keystonemiddleware.auth_token [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 16:51:08.523095 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: WARNING keystonemiddleware.auth_token [None req-aa71b2bd-81c1-4a07-8d17-9955d8435d61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 16:51:08.529368 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564bfde619c0 pid: 130235 (default app) Aug 08 16:51:43.886530 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=3 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:51:43.886530 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=3 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:51:43.887468 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=3 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:51:43.887771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=3 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:51:45.305100 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b7a4db7b-338b-4204-97ee-8ba14e02518a tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Action: 'create', calling method: .version_select at 0x7f501811cdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2019953899", "metadata": {"Type": "work"}}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b7a4db7b-338b-4204-97ee-8ba14e02518a tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Request method failure captured: Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 122 Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T8fNhZYhQvEwlLoUAdNHZJz5LH-fBB037ZLpLvJm_Xak75A4GOq6RpCFKBb1_Q0GCqhkFxbLUPT1c4RlEfbgNJriFj08fAt2S4C68MTZpbKC0pJEM8sa3O79li7YuPg1RfB2W1ac6HlhmXgtgVOwAsjAn8aP-J5tzDqbxsCn6GktfQ Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: 4ab7868e73de46a2afb92c597bb549bc Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 16:51:45.313054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 16:51:45.314478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4ab7868e73de46a2afb92c597bb549bc", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:51:45.314478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:45.314478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: 4ab7868e73de46a2afb92c597bb549bc Aug 08 16:51:45.314478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:45.314478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-VolumesNegativeTest-1475834934-project Aug 08 16:51:45.314478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 16:51:45.314478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 16:51:45.314478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: dfa25d3c6a0e4732894b0f6cd7ff4845 Aug 08 16:51:45.314478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-VolumesNegativeTest-1475834934-project Aug 08 16:51:45.314478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Aug 08 16:51:45.314478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2019953899", "metadata": {"Type": "work"}}} Aug 08 16:51:45.314478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: Aug 08 16:51:45.314478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2019953899', 'metadata': {'Type': 'work'}}}} Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise error Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi '#$%' Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:51:45.316082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 16:51:45.317466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 16:51:45.320771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 16:51:45.320771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.320771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b7a4db7b-338b-4204-97ee-8ba14e02518a tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:51:45.320771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b7a4db7b-338b-4204-97ee-8ba14e02518a tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.437412 Aug 08 16:51:45.320771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1156 bytes} [Mon Aug 8 16:51:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1440 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 16:51:45.579553 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f9dba332-8ab5-49ed-9174-e39dee286942 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Action: 'create', calling method: .version_select at 0x7f50181f58b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-889890736", "metadata": {"Type": "work"}}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f9dba332-8ab5-49ed-9174-e39dee286942 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Request method failure captured: Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 119 Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8fNhZYhQvEwlLoUAdNHZJz5LH-fBB037ZLpLvJm_Xak75A4GOq6RpCFKBb1_Q0GCqhkFxbLUPT1c4RlEfbgNJriFj08fAt2S4C68MTZpbKC0pJEM8sa3O79li7YuPg1RfB2W1ac6HlhmXgtgVOwAsjAn8aP-J5tzDqbxsCn6GktfQ Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 4ab7868e73de46a2afb92c597bb549bc Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:51:45.587889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:51:45.590917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4ab7868e73de46a2afb92c597bb549bc", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:51:45.590917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:45.590917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 4ab7868e73de46a2afb92c597bb549bc Aug 08 16:51:45.590917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:45.590917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-VolumesNegativeTest-1475834934-project Aug 08 16:51:45.590917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:51:45.590917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:51:45.590917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: dfa25d3c6a0e4732894b0f6cd7ff4845 Aug 08 16:51:45.590917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-VolumesNegativeTest-1475834934-project Aug 08 16:51:45.590917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Aug 08 16:51:45.590917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-889890736", "metadata": {"Type": "work"}}} Aug 08 16:51:45.590917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: Aug 08 16:51:45.590917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-889890736', 'metadata': {'Type': 'work'}}}} Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise error Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi '0' Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:51:45.592698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 16:51:45.596364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 16:51:45.598971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 16:51:45.598971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.598971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f9dba332-8ab5-49ed-9174-e39dee286942 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:51:45.598971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f9dba332-8ab5-49ed-9174-e39dee286942 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.267205 Aug 08 16:51:45.598971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 1/2] 10.222.0.13 () {60 vars in 1156 bytes} [Mon Aug 8 16:51:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 274 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 16:51:45.603170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f10cd62b-4f5b-4761-8919-8826749dab6f tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Action: 'create', calling method: .version_select at 0x7f5018181f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1475985408", "metadata": {"Type": "work"}}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f10cd62b-4f5b-4761-8919-8826749dab6f tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Request method failure captured: Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 119 Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8fNhZYhQvEwlLoUAdNHZJz5LH-fBB037ZLpLvJm_Xak75A4GOq6RpCFKBb1_Q0GCqhkFxbLUPT1c4RlEfbgNJriFj08fAt2S4C68MTZpbKC0pJEM8sa3O79li7YuPg1RfB2W1ac6HlhmXgtgVOwAsjAn8aP-J5tzDqbxsCn6GktfQ Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 4ab7868e73de46a2afb92c597bb549bc Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:51:45.606678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:51:45.616757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4ab7868e73de46a2afb92c597bb549bc", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:51:45.616757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:45.616757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 4ab7868e73de46a2afb92c597bb549bc Aug 08 16:51:45.616757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:45.616757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-VolumesNegativeTest-1475834934-project Aug 08 16:51:45.616757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:51:45.616757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:51:45.616757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: dfa25d3c6a0e4732894b0f6cd7ff4845 Aug 08 16:51:45.616757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-VolumesNegativeTest-1475834934-project Aug 08 16:51:45.616757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Aug 08 16:51:45.616757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1475985408", "metadata": {"Type": "work"}}} Aug 08 16:51:45.616757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: Aug 08 16:51:45.616757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1475985408', 'metadata': {'Type': 'work'}}}} Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise error Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi '' Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:51:45.618405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 16:51:45.623679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 16:51:45.627090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 16:51:45.627090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:45.627090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f10cd62b-4f5b-4761-8919-8826749dab6f tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:51:45.627090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f10cd62b-4f5b-4761-8919-8826749dab6f tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010425 Aug 08 16:51:45.627090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1156 bytes} [Mon Aug 8 16:51:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 16:51:45.627090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-da18772c-0fab-4bb9-9313-530945bf8299 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Calling method '.version_select at 0x7f501803f310>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:45.659025 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:51:45.660317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:51:45.661823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:51:45.663233 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:51:46.156459 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-01aca82d-0eae-4913-9c21-62622cbecb1b tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Action: 'create', calling method: .version_select at 0x7f50180288b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-381008066"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:51:47.248077 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-da18772c-0fab-4bb9-9313-530945bf8299 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] HTTP exception thrown: Volume tempest-invalid-1093795335 could not be found. Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-da18772c-0fab-4bb9-9313-530945bf8299 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Request method failure captured: Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1093795335 HTTP/1.1 Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8fNhZYhQvEwlLoUAdNHZJz5LH-fBB037ZLpLvJm_Xak75A4GOq6RpCFKBb1_Q0GCqhkFxbLUPT1c4RlEfbgNJriFj08fAt2S4C68MTZpbKC0pJEM8sa3O79li7YuPg1RfB2W1ac6HlhmXgtgVOwAsjAn8aP-J5tzDqbxsCn6GktfQ Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 4ab7868e73de46a2afb92c597bb549bc Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:51:47.265731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:51:47.267170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4ab7868e73de46a2afb92c597bb549bc", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:51:47.267170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:47.267170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 4ab7868e73de46a2afb92c597bb549bc Aug 08 16:51:47.267170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:47.267170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-VolumesNegativeTest-1475834934-project Aug 08 16:51:47.267170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:51:47.267170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:51:47.267170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: dfa25d3c6a0e4732894b0f6cd7ff4845 Aug 08 16:51:47.267170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-VolumesNegativeTest-1475834934-project Aug 08 16:51:47.267170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: Aug 08 16:51:47.267170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Volume tempest-invalid-1093795335 could not be found. Aug 08 16:51:47.267170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'tempest-invalid-1093795335'} Aug 08 16:51:47.267170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1093795335 could not be found. (HTTP 404) (Request-ID: req-3612ce60-b432-41ab-81a2-01ca698c735b) Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:47.268036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 16:51:47.272570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1093795335 could not be found. Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:51:47.274098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1093795335 could not be found. Aug 08 16:51:47.276000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:47.276000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:47.276000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:47.276000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:47.276000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:47.276000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:47.276000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:51:47.276000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:51:47.276000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1093795335 could not be found. Aug 08 16:51:47.276000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:47.279390 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-da18772c-0fab-4bb9-9313-530945bf8299 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Returning 404 to user: Volume tempest-invalid-1093795335 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:51:47.281772 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-da18772c-0fab-4bb9-9313-530945bf8299 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1093795335" status: 404 len: 99 microversion: 2.1 time: 1.660903 Aug 08 16:51:47.282756 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 3/4] 10.222.0.13 () {58 vars in 1218 bytes} [Mon Aug 8 16:51:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1093795335 => generated 99 bytes in 1663 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 08 16:51:47.504274 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-00445804-ad2b-4a58-9032-5e615a4f1480 tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] Action: 'create', calling method: .version_select at 0x7f501807e430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-115518012", "metadata": {"Type": "work"}}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:51:48.928042 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-01aca82d-0eae-4913-9c21-62622cbecb1b tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.393662 Aug 08 16:51:48.972838 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 2/5] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Aug 8 16:51:45 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3396 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 16:51:48.972838 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fa3889d4-1742-4a66-8e50-0ecf5b15f460 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004545 Aug 08 16:51:48.972838 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 3/6] 10.222.0.13 () {58 vars in 1140 bytes} [Mon Aug 8 16:51:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 16:51:48.972838 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-82bfa855-4d90-41a6-bc67-6dd8ed778145 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008740 Aug 08 16:51:48.972838 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1137 bytes} [Mon Aug 8 16:51:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 08 16:51:48.980128 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4c42de20-9e4d-47e4-abdd-8007205be1ab tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f62670>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:49.057257 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-00445804-ad2b-4a58-9032-5e615a4f1480 tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.773218 Aug 08 16:51:49.058213 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 4/8] 10.222.0.13 () {60 vars in 1156 bytes} [Mon Aug 8 16:51:47 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1775 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 16:51:49.071166 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-09c4d547-b0dd-4ce6-89e3-9e875dc82721 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Calling method '.version_select at 0x7f5017f2a430>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:49.130007 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4c42de20-9e4d-47e4-abdd-8007205be1ab tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e" status: 200 len: 344 microversion: 2.1 time: 0.168912 Aug 08 16:51:49.130600 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 5/9] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:51:48 2022] GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e => generated 344 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:49.135770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-12278853-17a7-40ee-a449-b9cd584cbcf9 tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] Calling method '.version_select at 0x7f5017f62d30>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:49.154078 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-09c4d547-b0dd-4ce6-89e3-9e875dc82721 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] HTTP exception thrown: Volume 1a261554-afb1-4042-a780-8f81a3559950 could not be found. Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-09c4d547-b0dd-4ce6-89e3-9e875dc82721 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Request method failure captured: Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: DELETE /compute/v2.1/os-volumes/1a261554-afb1-4042-a780-8f81a3559950 HTTP/1.1 Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8fNhZYhQvEwlLoUAdNHZJz5LH-fBB037ZLpLvJm_Xak75A4GOq6RpCFKBb1_Q0GCqhkFxbLUPT1c4RlEfbgNJriFj08fAt2S4C68MTZpbKC0pJEM8sa3O79li7YuPg1RfB2W1ac6HlhmXgtgVOwAsjAn8aP-J5tzDqbxsCn6GktfQ Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 4ab7868e73de46a2afb92c597bb549bc Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:51:49.155846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:51:49.156908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4ab7868e73de46a2afb92c597bb549bc", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:51:49.156908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:49.156908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 4ab7868e73de46a2afb92c597bb549bc Aug 08 16:51:49.156908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:49.156908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-VolumesNegativeTest-1475834934-project Aug 08 16:51:49.156908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:51:49.156908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:51:49.156908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: dfa25d3c6a0e4732894b0f6cd7ff4845 Aug 08 16:51:49.156908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-VolumesNegativeTest-1475834934-project Aug 08 16:51:49.156908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: Aug 08 16:51:49.156908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Volume 1a261554-afb1-4042-a780-8f81a3559950 could not be found. Aug 08 16:51:49.156908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '1a261554-afb1-4042-a780-8f81a3559950'} Aug 08 16:51:49.156908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a261554-afb1-4042-a780-8f81a3559950 could not be found. (HTTP 404) (Request-ID: req-89a36ac5-5d3e-492c-b75d-3fcfd17321df) Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:49.157690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 16:51:49.158708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a261554-afb1-4042-a780-8f81a3559950 could not be found. Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 16:51:49.160343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:51:49.161275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a261554-afb1-4042-a780-8f81a3559950 could not be found. Aug 08 16:51:49.161275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.161275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:49.161275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.161275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:49.161275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:49.161275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:49.161275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:51:49.161275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:51:49.161275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a261554-afb1-4042-a780-8f81a3559950 could not be found. Aug 08 16:51:49.161275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.161275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-09c4d547-b0dd-4ce6-89e3-9e875dc82721 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Returning 404 to user: Volume 1a261554-afb1-4042-a780-8f81a3559950 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:51:49.161275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-09c4d547-b0dd-4ce6-89e3-9e875dc82721 tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/1a261554-afb1-4042-a780-8f81a3559950" status: 404 len: 109 microversion: 2.1 time: 0.098082 Aug 08 16:51:49.163091 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 5/10] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Aug 8 16:51:49 2022] DELETE /compute/v2.1/os-volumes/1a261554-afb1-4042-a780-8f81a3559950 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:51:49.169609 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-17b1f09c-7bb2-42e6-826b-3cef59249fdf tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Calling method '.version_select at 0x7f5017f1f280>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:49.210796 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-12278853-17a7-40ee-a449-b9cd584cbcf9 tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7b51c231-3614-42fc-98e9-029ada1f188a" status: 200 len: 352 microversion: 2.1 time: 0.079096 Aug 08 16:51:49.211698 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 6/11] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:51:49 2022] GET /compute/v2.1/os-volumes/7b51c231-3614-42fc-98e9-029ada1f188a => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:49.241753 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-17b1f09c-7bb2-42e6-826b-3cef59249fdf tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] HTTP exception thrown: Volume 8dfe8d1c-fedd-4695-a6bc-e7c2ad1313b1 could not be found. Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-17b1f09c-7bb2-42e6-826b-3cef59249fdf tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Request method failure captured: Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/os-volumes/8dfe8d1c-fedd-4695-a6bc-e7c2ad1313b1 HTTP/1.1 Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8fNhZYhQvEwlLoUAdNHZJz5LH-fBB037ZLpLvJm_Xak75A4GOq6RpCFKBb1_Q0GCqhkFxbLUPT1c4RlEfbgNJriFj08fAt2S4C68MTZpbKC0pJEM8sa3O79li7YuPg1RfB2W1ac6HlhmXgtgVOwAsjAn8aP-J5tzDqbxsCn6GktfQ Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 4ab7868e73de46a2afb92c597bb549bc Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:51:49.244509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:51:49.245889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4ab7868e73de46a2afb92c597bb549bc", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4ab7868e73de46a2afb92c597bb549bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:51:49.245889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:49.245889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 4ab7868e73de46a2afb92c597bb549bc Aug 08 16:51:49.245889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-VolumesNegativeTest-1475834934 Aug 08 16:51:49.245889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-VolumesNegativeTest-1475834934-project Aug 08 16:51:49.245889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:51:49.245889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:51:49.245889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: dfa25d3c6a0e4732894b0f6cd7ff4845 Aug 08 16:51:49.245889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-VolumesNegativeTest-1475834934-project Aug 08 16:51:49.245889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: Aug 08 16:51:49.245889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Volume 8dfe8d1c-fedd-4695-a6bc-e7c2ad1313b1 could not be found. Aug 08 16:51:49.245889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '8dfe8d1c-fedd-4695-a6bc-e7c2ad1313b1'} Aug 08 16:51:49.245889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8dfe8d1c-fedd-4695-a6bc-e7c2ad1313b1 could not be found. (HTTP 404) (Request-ID: req-66c6df8e-a96d-4374-abd3-f01e931cbee6) Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:49.246685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 16:51:49.247952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8dfe8d1c-fedd-4695-a6bc-e7c2ad1313b1 could not be found. Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 16:51:49.249088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:51:49.250167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8dfe8d1c-fedd-4695-a6bc-e7c2ad1313b1 could not be found. Aug 08 16:51:49.250167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.250167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:49.250167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.250167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:49.250167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:49.250167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:49.250167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:51:49.250167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:51:49.250167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8dfe8d1c-fedd-4695-a6bc-e7c2ad1313b1 could not be found. Aug 08 16:51:49.250167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:51:49.252068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-17b1f09c-7bb2-42e6-826b-3cef59249fdf tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] Returning 404 to user: Volume 8dfe8d1c-fedd-4695-a6bc-e7c2ad1313b1 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:51:49.253102 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-17b1f09c-7bb2-42e6-826b-3cef59249fdf tempest-VolumesNegativeTest-1475834934 tempest-VolumesNegativeTest-1475834934-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8dfe8d1c-fedd-4695-a6bc-e7c2ad1313b1" status: 404 len: 109 microversion: 2.1 time: 0.088978 Aug 08 16:51:49.253663 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:51:49 2022] GET /compute/v2.1/os-volumes/8dfe8d1c-fedd-4695-a6bc-e7c2ad1313b1 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:51:50.144858 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5373deb7-1d6d-4c85-952f-4fb943da9d6c tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f62af0>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:50.240497 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f7cec8c4-d582-4f24-9237-19df39c439fc tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] Calling method '.version_select at 0x7f501807eee0>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:50.255861 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5373deb7-1d6d-4c85-952f-4fb943da9d6c tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e" status: 200 len: 345 microversion: 2.1 time: 0.114872 Aug 08 16:51:50.256660 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:51:50 2022] GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e => generated 345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:50.270882 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4a937afb-3a14-4e6b-874d-ef896a1578fd tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Action: 'create', calling method: .version_select at 0x7f5017f62430>, body: {"snapshot": {"volume_id": "b857c4fc-b818-4b47-a86d-aa8240dfae0e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1421159248"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:51:50.377293 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f7cec8c4-d582-4f24-9237-19df39c439fc tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7b51c231-3614-42fc-98e9-029ada1f188a" status: 200 len: 353 microversion: 2.1 time: 0.155602 Aug 08 16:51:50.389881 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 7/14] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:51:50 2022] GET /compute/v2.1/os-volumes/7b51c231-3614-42fc-98e9-029ada1f188a => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:50.395511 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ddc80f12-9d65-4757-94f0-8ae55cf64f97 tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] Calling method '.version_select at 0x7f5017f2a790>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:50.559082 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ddc80f12-9d65-4757-94f0-8ae55cf64f97 tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7b51c231-3614-42fc-98e9-029ada1f188a" status: 200 len: 353 microversion: 2.1 time: 0.168025 Aug 08 16:51:50.559683 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 8/15] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:51:50 2022] GET /compute/v2.1/os-volumes/7b51c231-3614-42fc-98e9-029ada1f188a => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:50.577730 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c4b92e39-bc70-4208-8ecc-e3fae9725296 tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] Calling method '.version_select at 0x7f5017f1fb80>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:51.104030 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c4b92e39-bc70-4208-8ecc-e3fae9725296 tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/7b51c231-3614-42fc-98e9-029ada1f188a" status: 202 len: 0 microversion: 2.1 time: 0.529823 Aug 08 16:51:51.108770 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 9/16] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Aug 8 16:51:50 2022] DELETE /compute/v2.1/os-volumes/7b51c231-3614-42fc-98e9-029ada1f188a => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:51:51.116214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-60d8072d-b732-4682-b1b0-388c24add1cf tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] Calling method '.version_select at 0x7f5017f1f9d0>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:51.196530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-60d8072d-b732-4682-b1b0-388c24add1cf tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7b51c231-3614-42fc-98e9-029ada1f188a" status: 200 len: 352 microversion: 2.1 time: 0.085919 Aug 08 16:51:51.199039 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 10/17] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:51:51 2022] GET /compute/v2.1/os-volumes/7b51c231-3614-42fc-98e9-029ada1f188a => generated 352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:51.391638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4a937afb-3a14-4e6b-874d-ef896a1578fd tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.123722 Aug 08 16:51:51.402214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 8/18] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Aug 8 16:51:50 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:51:51.406991 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-94c9807e-c27b-403b-bfdc-4ef02b9776e6 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f2a4c0>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:51.762191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-94c9807e-c27b-403b-bfdc-4ef02b9776e6 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a" status: 200 len: 287 microversion: 2.1 time: 0.360343 Aug 08 16:51:51.763043 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 11/19] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Aug 8 16:51:51 2022] GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a => generated 287 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:51.773788 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-94d3de3d-8c02-411c-8360-92bb4bd49c7f tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f6d9d0>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:51.869791 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-94d3de3d-8c02-411c-8360-92bb4bd49c7f tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.099380 Aug 08 16:51:51.870977 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 9/20] 10.222.0.13 () {58 vars in 1140 bytes} [Mon Aug 8 16:51:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:51.884652 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-80816a71-8863-455d-9f5e-a34a83a4d8e8 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f2aca0>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:51.953196 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-80816a71-8863-455d-9f5e-a34a83a4d8e8 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a" status: 200 len: 287 microversion: 2.1 time: 0.073786 Aug 08 16:51:51.953766 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 12/21] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Aug 8 16:51:51 2022] GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:52.218660 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-aa5502c1-4540-432a-adf4-2314ee762a1a tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] Calling method '.version_select at 0x7f5017f6db80>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:52.316687 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-aa5502c1-4540-432a-adf4-2314ee762a1a tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] HTTP exception thrown: Volume 7b51c231-3614-42fc-98e9-029ada1f188a could not be found. Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-aa5502c1-4540-432a-adf4-2314ee762a1a tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] Request method failure captured: Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: GET /compute/v2.1/os-volumes/7b51c231-3614-42fc-98e9-029ada1f188a HTTP/1.1 Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T8hsybYe4vOI8F6aUjqU3Z3lqmTCZnuuExoUmp5faqBpsl9djE48YmckyTtbDk92BqSnN6NkYEFPi5jwKRmUZ-e_nZeOH4Ly6J6jhPivBBJJKy4dlEg4knjhbO732eq9sh02bN9wKSxFBVMd6iG61WaW-5cRMzK1u4akwT86xopp_A Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: 00921bd60b1046b4b852832971a86af8 Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-VolumesGetTestJSON-1610378022 Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 16:51:52.321479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 16:51:52.322638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_00921bd60b1046b4b852832971a86af8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/00921bd60b1046b4b852832971a86af8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/00921bd60b1046b4b852832971a86af8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/00921bd60b1046b4b852832971a86af8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:51:52.322638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-VolumesGetTestJSON-1610378022 Aug 08 16:51:52.322638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: 00921bd60b1046b4b852832971a86af8 Aug 08 16:51:52.322638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-VolumesGetTestJSON-1610378022 Aug 08 16:51:52.322638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-VolumesGetTestJSON-1610378022-project Aug 08 16:51:52.322638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 16:51:52.322638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 16:51:52.322638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: 65de55053dc84a119bcf9acbe880cdb7 Aug 08 16:51:52.322638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-VolumesGetTestJSON-1610378022-project Aug 08 16:51:52.322638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: Aug 08 16:51:52.322638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Volume 7b51c231-3614-42fc-98e9-029ada1f188a could not be found. Aug 08 16:51:52.322638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': '7b51c231-3614-42fc-98e9-029ada1f188a'} Aug 08 16:51:52.322638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b51c231-3614-42fc-98e9-029ada1f188a could not be found. (HTTP 404) (Request-ID: req-369b6c47-ea28-4403-bc5e-08bd1ee8e56e) Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:52.323396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 16:51:52.324343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b51c231-3614-42fc-98e9-029ada1f188a could not be found. Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 16:51:52.325275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:51:52.326392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b51c231-3614-42fc-98e9-029ada1f188a could not be found. Aug 08 16:51:52.326392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:52.326392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:52.326392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:52.326392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:52.326392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:52.326392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:52.326392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:51:52.326392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:51:52.326392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b51c231-3614-42fc-98e9-029ada1f188a could not be found. Aug 08 16:51:52.326392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:52.329279 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-aa5502c1-4540-432a-adf4-2314ee762a1a tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] Returning 404 to user: Volume 7b51c231-3614-42fc-98e9-029ada1f188a could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:51:52.331024 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-aa5502c1-4540-432a-adf4-2314ee762a1a tempest-VolumesGetTestJSON-1610378022 tempest-VolumesGetTestJSON-1610378022-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7b51c231-3614-42fc-98e9-029ada1f188a" status: 404 len: 109 microversion: 2.1 time: 0.122328 Aug 08 16:51:52.335465 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 10/22] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:51:52 2022] GET /compute/v2.1/os-volumes/7b51c231-3614-42fc-98e9-029ada1f188a => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:51:52.968237 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c7006a1d-608d-4278-a8b3-3d336d2383c5 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f1fdc0>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:53.145983 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c7006a1d-608d-4278-a8b3-3d336d2383c5 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a" status: 200 len: 287 microversion: 2.1 time: 0.183027 Aug 08 16:51:53.146756 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 13/23] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Aug 8 16:51:52 2022] GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a => generated 287 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:54.166214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-208057d9-44c3-46f2-a5f3-8e6935551731 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5018968c10>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:54.217831 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-208057d9-44c3-46f2-a5f3-8e6935551731 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a" status: 200 len: 287 microversion: 2.1 time: 0.059799 Aug 08 16:51:54.218599 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 11/24] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Aug 8 16:51:54 2022] GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:55.231264 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8cf949df-df1d-42a5-96a6-d6024af9ac54 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f1f670>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:55.359883 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8cf949df-df1d-42a5-96a6-d6024af9ac54 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a" status: 200 len: 288 microversion: 2.1 time: 0.131540 Aug 08 16:51:55.359883 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 14/25] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Aug 8 16:51:55 2022] GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a => generated 288 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:55.370520 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-adc3637b-edd5-47dc-baa7-38ada57a7298 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f6da60>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:55.607085 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-adc3637b-edd5-47dc-baa7-38ada57a7298 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a" status: 202 len: 0 microversion: 2.1 time: 0.238968 Aug 08 16:51:55.609055 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 12/26] 10.222.0.13 () {58 vars in 1254 bytes} [Mon Aug 8 16:51:55 2022] DELETE /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:51:55.618625 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3bcc72ea-cd27-4d8d-9cf4-202d5de061f1 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f2a280>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:55.700325 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-3bcc72ea-cd27-4d8d-9cf4-202d5de061f1 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a" status: 200 len: 287 microversion: 2.1 time: 0.087491 Aug 08 16:51:55.700987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 15/27] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Aug 8 16:51:55 2022] GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:51:56.713973 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c8384221-cfaa-4484-80a3-5f3c0f355d25 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f75280>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:56.751595 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-c8384221-cfaa-4484-80a3-5f3c0f355d25 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] HTTP exception thrown: Snapshot e86a1616-45b7-43c7-8ac8-89e10a21d86a could not be found. Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c8384221-cfaa-4484-80a3-5f3c0f355d25 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Request method failure captured: Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a HTTP/1.1 Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T8hVbec2-F6ngv6phx10FxpILl871GXuWuf1kcfh0gtzSAQjeuyhkpC5fWh9T0pZKKTBNi6l8d6hL8j7rd5p4dwCGxGvs1qfv825FHc7LnET1Wj6SGw5UmrjmwHSryENZMRSR6oDsr6xx_Z-tg-6Tish_ujXPAHnw5PBvCUXbrUZxg Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: a8ded1aab7c448aba3df1805e4644c43 Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-335046264 Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 16:51:56.754300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 16:51:56.755693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a8ded1aab7c448aba3df1805e4644c43", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a8ded1aab7c448aba3df1805e4644c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a8ded1aab7c448aba3df1805e4644c43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a8ded1aab7c448aba3df1805e4644c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:51:56.755693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-VolumesSnapshotsTestJSON-335046264 Aug 08 16:51:56.755693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: a8ded1aab7c448aba3df1805e4644c43 Aug 08 16:51:56.755693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-335046264 Aug 08 16:51:56.755693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-VolumesSnapshotsTestJSON-335046264-project Aug 08 16:51:56.755693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 16:51:56.755693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 16:51:56.755693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: d447f638293d4d4cb68551e07a397725 Aug 08 16:51:56.755693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-VolumesSnapshotsTestJSON-335046264-project Aug 08 16:51:56.755693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: Aug 08 16:51:56.755693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Snapshot e86a1616-45b7-43c7-8ac8-89e10a21d86a could not be found. Aug 08 16:51:56.755693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': 'e86a1616-45b7-43c7-8ac8-89e10a21d86a'} Aug 08 16:51:56.755693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e86a1616-45b7-43c7-8ac8-89e10a21d86a could not be found. (HTTP 404) (Request-ID: req-b8029aaf-c57b-4703-8227-3015e81edc45) Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:56.756542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 16:51:56.757550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e86a1616-45b7-43c7-8ac8-89e10a21d86a could not be found. Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 08 16:51:56.758518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:51:56.759507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e86a1616-45b7-43c7-8ac8-89e10a21d86a could not be found. Aug 08 16:51:56.759507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:56.759507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:51:56.759507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:56.759507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:51:56.759507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:51:56.759507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:51:56.759507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:51:56.759507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:51:56.759507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e86a1616-45b7-43c7-8ac8-89e10a21d86a could not be found. Aug 08 16:51:56.759507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:51:56.761544 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c8384221-cfaa-4484-80a3-5f3c0f355d25 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Returning 404 to user: Snapshot e86a1616-45b7-43c7-8ac8-89e10a21d86a could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:51:56.763929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c8384221-cfaa-4484-80a3-5f3c0f355d25 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a" status: 404 len: 111 microversion: 2.1 time: 0.052937 Aug 08 16:51:56.764863 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 13/28] 10.222.0.13 () {58 vars in 1251 bytes} [Mon Aug 8 16:51:56 2022] GET /compute/v2.1/os-snapshots/e86a1616-45b7-43c7-8ac8-89e10a21d86a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:51:56.781276 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a299ecfb-e563-4bcc-a6b6-c2bb82fe1305 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f2a940>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:57.098971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a299ecfb-e563-4bcc-a6b6-c2bb82fe1305 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e" status: 202 len: 0 microversion: 2.1 time: 0.322670 Aug 08 16:51:57.109035 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 16/29] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Aug 8 16:51:56 2022] DELETE /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:51:57.118145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c490be9c-5f67-422d-b7dc-bcc0d75f94d7 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f6d4c0>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:57.210045 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c490be9c-5f67-422d-b7dc-bcc0d75f94d7 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e" status: 200 len: 344 microversion: 2.1 time: 0.097339 Aug 08 16:51:57.210644 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 14/30] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:51:57 2022] GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:58.224762 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-76a56c7c-bf8a-4ccc-a498-f12419838ae6 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f1fc10>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:58.386078 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-76a56c7c-bf8a-4ccc-a498-f12419838ae6 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e" status: 200 len: 344 microversion: 2.1 time: 0.165092 Aug 08 16:51:58.396843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 17/31] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:51:58 2022] GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e => generated 344 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:59.409793 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-022407af-ac8b-4534-87d9-f3a270013d2d tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f1f280>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:51:59.568662 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-022407af-ac8b-4534-87d9-f3a270013d2d tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e" status: 200 len: 344 microversion: 2.1 time: 0.167510 Aug 08 16:51:59.577992 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 18/32] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:51:59 2022] GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e => generated 344 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:51:59.805134 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d9549c1b-fb16-4054-a47f-8e2c53d9881b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Action: 'create', calling method: .version_select at 0x7f5017f62790>, body: {"keypair": {"name": "tempest-keypair-1286572764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg6nn/8NRkqeFI5vNqo3GCqAkukOepSVP+5uWV2E+K2lKaoQtS520A+DR8LFCk9hVoBk115z6wu5nPyawMhr249dBXBnJW+eMwRrGLfatCx8qoDXiN2ALSLOEJrxUPbEQ=="}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:51:59.930869 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-d9549c1b-fb16-4054-a47f-8e2c53d9881b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for project b2063a114c1942cab80ae4b708be9ab2. Resources: {'key_pairs'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:51:59.942178 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-d9549c1b-fb16-4054-a47f-8e2c53d9881b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for user fdb16e7edbe143e9b96325842896f04e and project b2063a114c1942cab80ae4b708be9ab2. Resources: {'key_pairs'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:52:00.123937 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d9549c1b-fb16-4054-a47f-8e2c53d9881b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.735586 Aug 08 16:52:00.123937 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 15/33] 10.222.0.13 () {60 vars in 1159 bytes} [Mon Aug 8 16:51:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:00.585174 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-67b22fb9-7500-439e-9b5a-9a7898793dc5 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f2a160>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:00.875356 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-67b22fb9-7500-439e-9b5a-9a7898793dc5 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] HTTP exception thrown: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-67b22fb9-7500-439e-9b5a-9a7898793dc5 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Request method failure captured: Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e HTTP/1.1 Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8hVbec2-F6ngv6phx10FxpILl871GXuWuf1kcfh0gtzSAQjeuyhkpC5fWh9T0pZKKTBNi6l8d6hL8j7rd5p4dwCGxGvs1qfv825FHc7LnET1Wj6SGw5UmrjmwHSryENZMRSR6oDsr6xx_Z-tg-6Tish_ujXPAHnw5PBvCUXbrUZxg Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: a8ded1aab7c448aba3df1805e4644c43 Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-335046264 Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:52:00.878690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:52:00.880104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a8ded1aab7c448aba3df1805e4644c43", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a8ded1aab7c448aba3df1805e4644c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a8ded1aab7c448aba3df1805e4644c43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a8ded1aab7c448aba3df1805e4644c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:52:00.880104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-VolumesSnapshotsTestJSON-335046264 Aug 08 16:52:00.880104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: a8ded1aab7c448aba3df1805e4644c43 Aug 08 16:52:00.880104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-335046264 Aug 08 16:52:00.880104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-VolumesSnapshotsTestJSON-335046264-project Aug 08 16:52:00.880104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:52:00.880104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:52:00.880104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: d447f638293d4d4cb68551e07a397725 Aug 08 16:52:00.880104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-VolumesSnapshotsTestJSON-335046264-project Aug 08 16:52:00.880104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: Aug 08 16:52:00.880104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:00.880104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'b857c4fc-b818-4b47-a86d-aa8240dfae0e'} Aug 08 16:52:00.880104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. (HTTP 404) (Request-ID: req-339be7b8-0ced-4979-80d4-660cdfab742d) Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:52:00.880864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 16:52:00.881882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 16:52:00.884226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:52:00.888468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:00.888468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:00.888468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:52:00.888468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:00.888468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:52:00.888468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:52:00.888468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:52:00.888468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:52:00.888468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:52:00.888468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:00.888468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:00.888468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-67b22fb9-7500-439e-9b5a-9a7898793dc5 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Returning 404 to user: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:52:00.888468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-67b22fb9-7500-439e-9b5a-9a7898793dc5 tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e" status: 404 len: 109 microversion: 2.1 time: 0.305540 Aug 08 16:52:00.902134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 19/34] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:52:00 2022] GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e => generated 109 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:52:00.912492 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-60f540e6-2d56-412f-b05a-d578303b48fd tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f1f5e0>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:00.951160 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1590488688", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:01.099258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-60f540e6-2d56-412f-b05a-d578303b48fd tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] HTTP exception thrown: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-60f540e6-2d56-412f-b05a-d578303b48fd tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Request method failure captured: Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: DELETE /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e HTTP/1.1 Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8hVbec2-F6ngv6phx10FxpILl871GXuWuf1kcfh0gtzSAQjeuyhkpC5fWh9T0pZKKTBNi6l8d6hL8j7rd5p4dwCGxGvs1qfv825FHc7LnET1Wj6SGw5UmrjmwHSryENZMRSR6oDsr6xx_Z-tg-6Tish_ujXPAHnw5PBvCUXbrUZxg Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: a8ded1aab7c448aba3df1805e4644c43 Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-335046264 Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:52:01.102720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:52:01.103843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a8ded1aab7c448aba3df1805e4644c43", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a8ded1aab7c448aba3df1805e4644c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a8ded1aab7c448aba3df1805e4644c43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a8ded1aab7c448aba3df1805e4644c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:52:01.103843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-VolumesSnapshotsTestJSON-335046264 Aug 08 16:52:01.103843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: a8ded1aab7c448aba3df1805e4644c43 Aug 08 16:52:01.103843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-335046264 Aug 08 16:52:01.103843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-VolumesSnapshotsTestJSON-335046264-project Aug 08 16:52:01.103843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:52:01.103843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:52:01.103843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: d447f638293d4d4cb68551e07a397725 Aug 08 16:52:01.103843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-VolumesSnapshotsTestJSON-335046264-project Aug 08 16:52:01.103843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: Aug 08 16:52:01.103843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:01.103843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'b857c4fc-b818-4b47-a86d-aa8240dfae0e'} Aug 08 16:52:01.103843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. (HTTP 404) (Request-ID: req-61220794-0042-403d-8637-e54af99b6b55) Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:52:01.104493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 16:52:01.105500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 16:52:01.106801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:52:01.108068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:01.108068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.108068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:52:01.108068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.108068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:52:01.108068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:52:01.108068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:52:01.108068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:52:01.108068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:52:01.108068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:01.108068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.110053 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-60f540e6-2d56-412f-b05a-d578303b48fd tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Returning 404 to user: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:52:01.111136 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-60f540e6-2d56-412f-b05a-d578303b48fd tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e" status: 404 len: 109 microversion: 2.1 time: 0.207651 Aug 08 16:52:01.112045 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 20/35] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Aug 8 16:52:00 2022] DELETE /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e => generated 109 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:52:01.123156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-345a94d1-71ba-4fae-9eb0-c17b7b0ff61a tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Calling method '.version_select at 0x7f5017f2a3a0>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:01.165372 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.network.neutron [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] validate_networks() for [('c1eb484d-fc4e-424a-97e1-7a3cf0b73a68', None, None, None, None, None)] {{(pid=130236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:52:01.321321 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-345a94d1-71ba-4fae-9eb0-c17b7b0ff61a tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] HTTP exception thrown: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-345a94d1-71ba-4fae-9eb0-c17b7b0ff61a tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Request method failure captured: Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e HTTP/1.1 Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8hVbec2-F6ngv6phx10FxpILl871GXuWuf1kcfh0gtzSAQjeuyhkpC5fWh9T0pZKKTBNi6l8d6hL8j7rd5p4dwCGxGvs1qfv825FHc7LnET1Wj6SGw5UmrjmwHSryENZMRSR6oDsr6xx_Z-tg-6Tish_ujXPAHnw5PBvCUXbrUZxg Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: a8ded1aab7c448aba3df1805e4644c43 Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-335046264 Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:52:01.324637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:52:01.326173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a8ded1aab7c448aba3df1805e4644c43", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a8ded1aab7c448aba3df1805e4644c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a8ded1aab7c448aba3df1805e4644c43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a8ded1aab7c448aba3df1805e4644c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:52:01.326173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-VolumesSnapshotsTestJSON-335046264 Aug 08 16:52:01.326173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: a8ded1aab7c448aba3df1805e4644c43 Aug 08 16:52:01.326173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-335046264 Aug 08 16:52:01.326173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-VolumesSnapshotsTestJSON-335046264-project Aug 08 16:52:01.326173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:52:01.326173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:52:01.326173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: d447f638293d4d4cb68551e07a397725 Aug 08 16:52:01.326173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-VolumesSnapshotsTestJSON-335046264-project Aug 08 16:52:01.326173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: Aug 08 16:52:01.326173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:01.326173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'b857c4fc-b818-4b47-a86d-aa8240dfae0e'} Aug 08 16:52:01.326173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. (HTTP 404) (Request-ID: req-5295cf85-6f98-412b-b9a0-ca1af256a9b9) Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:52:01.327028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 16:52:01.328460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 16:52:01.330066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:52:01.335019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:01.335019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.335019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:52:01.335019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.335019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:52:01.335019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:52:01.335019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:52:01.335019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:52:01.335019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:52:01.335019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. Aug 08 16:52:01.335019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:52:01.335019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-345a94d1-71ba-4fae-9eb0-c17b7b0ff61a tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] Returning 404 to user: Volume b857c4fc-b818-4b47-a86d-aa8240dfae0e could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:52:01.339415 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-345a94d1-71ba-4fae-9eb0-c17b7b0ff61a tempest-VolumesSnapshotsTestJSON-335046264 tempest-VolumesSnapshotsTestJSON-335046264-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e" status: 404 len: 109 microversion: 2.1 time: 0.218062 Aug 08 16:52:01.340773 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 21/36] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:52:01 2022] GET /compute/v2.1/os-volumes/b857c4fc-b818-4b47-a86d-aa8240dfae0e => generated 109 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:52:04.104285 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e4d262e8-d85a-4b92-824b-10dc488aea53 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Action: 'create', calling method: .version_select at 0x7f5017f1f4c0>, body: {"keypair": {"name": "tempest-keypair-1704036561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ30had75Gfu8ZKEHCexb9X6AjnC6QnyluY6Hhe4w+stMeE2MKQNAgq3A71f0oE5+ltp8vzs1fXAqF5bsnF29Ir2jICBWSV8xp24VEaUYnAcjXeMSB8wGZ94maOSAOWqg=="}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:04.234357 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-e4d262e8-d85a-4b92-824b-10dc488aea53 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Getting quotas for project 442f2ca88fce4cbab9c01278239b77ce. Resources: {'key_pairs'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:52:04.253850 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-e4d262e8-d85a-4b92-824b-10dc488aea53 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Getting quotas for user 5a8db3ff64ca44958fd633ba25ee191f and project 442f2ca88fce4cbab9c01278239b77ce. Resources: {'key_pairs'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:52:04.485085 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e4d262e8-d85a-4b92-824b-10dc488aea53 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.647437 Aug 08 16:52:04.489670 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 22/37] 10.222.0.13 () {60 vars in 1159 bytes} [Mon Aug 8 16:52:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:04.656067 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Flavor limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:52:04.656495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Image limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:52:04.656961 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Flavor pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:52:04.657369 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Image pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:52:04.657784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:52:04.688280 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:04.688773 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:04.689204 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:04.689932 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:04.690382 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:04.692465 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:04.768864 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Getting quotas for project 6cac5ca5a8b04bce9a9d8ac938cd35e8. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:52:04.775332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Getting quotas for user 75d793a42ec74232899b7a19e36b5867 and project 6cac5ca5a8b04bce9a9d8ac938cd35e8. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:52:04.798299 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Going to run 1 instances... {{(pid=130236) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:52:04.808713 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:52:05.052005 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c402bdf9-4276-47bf-bda5-a67a5b53799f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.451913 Aug 08 16:52:05.075050 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5dcfe299-7155-4b4a-8ee1-0f7954760171 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:05.075832 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5dcfe299-7155-4b4a-8ee1-0f7954760171 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:05.081759 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 16/38] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:52:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 4455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 16:52:05.510965 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5dcfe299-7155-4b4a-8ee1-0f7954760171 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:05.538502 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5dcfe299-7155-4b4a-8ee1-0f7954760171 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1222 microversion: 2.1 time: 0.470490 Aug 08 16:52:05.551909 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 23/39] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:05 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1222 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:05.904954 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1227344416", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:06.286058 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.network.neutron [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] validate_networks() for [('c1eb484d-fc4e-424a-97e1-7a3cf0b73a68', None, None, None, None, None)] {{(pid=130235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:52:06.327701 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1103761058", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "networks": [{"uuid": "b09a83d2-aaea-46ef-8b96-c421b9fab9f0"}]}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:06.561573 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.network.neutron [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] validate_networks() for [('b09a83d2-aaea-46ef-8b96-c421b9fab9f0', None, None, None, None, None)] {{(pid=130236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:52:07.784158 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Flavor limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:52:07.784781 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Image limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:52:07.785040 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Flavor pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:52:07.785454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Image pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:52:07.785867 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:52:07.816262 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:07.816779 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:07.817205 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:07.831932 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:07.832230 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:07.847473 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:07.951446 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Getting quotas for project e8beb878fb0d489cb0a2cf4a569bf475. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:52:07.964261 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Getting quotas for user 5891c6b280bd4ad68ef411759fcdec46 and project e8beb878fb0d489cb0a2cf4a569bf475. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:52:07.982485 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Going to run 1 instances... {{(pid=130236) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:52:07.985000 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:52:08.119686 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-32d24c19-247d-4c71-b4e3-5a4f9cbe0ed7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.463480 Aug 08 16:52:08.122896 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 17/40] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:52:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 16:52:08.138460 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c1f0744b-712e-401b-932a-5298bcd7a3d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:08.141524 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c1f0744b-712e-401b-932a-5298bcd7a3d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:08.288100 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c1f0744b-712e-401b-932a-5298bcd7a3d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:08.316701 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c1f0744b-712e-401b-932a-5298bcd7a3d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1215 microversion: 2.1 time: 0.186167 Aug 08 16:52:08.317873 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 18/41] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:08 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:09.339726 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4a0844fe-9fb4-41a7-b311-812141e7db0a tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:09.340398 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4a0844fe-9fb4-41a7-b311-812141e7db0a tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:09.530101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4a0844fe-9fb4-41a7-b311-812141e7db0a tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:09.561814 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4a0844fe-9fb4-41a7-b311-812141e7db0a tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1215 microversion: 2.1 time: 0.207364 Aug 08 16:52:09.563645 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 19/42] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:09 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1215 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:09.590732 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-851956491", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13e31057-f543-4337-919e-432a457bba76"}], "security_groups": [{"name": "tempest-securitygroup--47988979"}], "key_name": "tempest-keypair-1286572764", "user_data": "}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:09.910608 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.network.neutron [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] validate_networks() for [('13e31057-f543-4337-919e-432a457bba76', None, None, None, None, None)] {{(pid=130236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:52:10.304032 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Flavor limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:52:10.306434 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Image limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:52:10.307774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Flavor pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:52:10.309589 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Image pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:52:10.316175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:52:10.374024 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:10.378814 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:10.382141 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:10.384207 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:10.389271 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:10.389890 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:10.480956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Getting quotas for project 6cac5ca5a8b04bce9a9d8ac938cd35e8. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:52:10.509168 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Getting quotas for user 75d793a42ec74232899b7a19e36b5867 and project 6cac5ca5a8b04bce9a9d8ac938cd35e8. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:52:10.551419 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Going to run 1 instances... {{(pid=130235) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:52:10.569030 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:52:10.881816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4835ffed-2c42-4f1d-ba09-7b64d3199376 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.984049 Aug 08 16:52:10.883561 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 24/43] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:52:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 4986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 16:52:10.895223 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a9b46c5a-99ce-444f-9ccb-7f8867f6b593 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:10.896065 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a9b46c5a-99ce-444f-9ccb-7f8867f6b593 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:10.998851 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Flavor limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:52:11.002676 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Image limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:52:11.002676 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Flavor pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:52:11.003348 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Image pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:52:11.012731 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:52:11.057835 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:11.064538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:11.067736 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:11.072959 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:11.081043 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:11.082304 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:11.162717 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a9b46c5a-99ce-444f-9ccb-7f8867f6b593 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:11.184594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for project b2063a114c1942cab80ae4b708be9ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:52:11.202755 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for user fdb16e7edbe143e9b96325842896f04e and project b2063a114c1942cab80ae4b708be9ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:52:11.233957 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a9b46c5a-99ce-444f-9ccb-7f8867f6b593 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1215 microversion: 2.1 time: 0.342740 Aug 08 16:52:11.239642 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 25/44] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:10 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1215 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:11.297743 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Going to run 1 instances... {{(pid=130236) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:52:11.299996 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3cf90210-907c-4041-8369-4a6a6fca3dca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:11.301043 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-3cf90210-907c-4041-8369-4a6a6fca3dca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:11.306975 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:52:11.517091 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-8feea580-9ab6-4fc2-8b01-639f7b11cb18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.952199 Aug 08 16:52:11.526504 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 20/45] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:52:09 2022] POST /compute/v2.1/servers => generated 400 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 16:52:11.551465 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-34ec51fa-518b-405e-976e-fa3446401797 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:11.564430 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-34ec51fa-518b-405e-976e-fa3446401797 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:11.644429 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-3cf90210-907c-4041-8369-4a6a6fca3dca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:11.655017 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-3cf90210-907c-4041-8369-4a6a6fca3dca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1222 microversion: 2.1 time: 0.400099 Aug 08 16:52:11.657501 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 26/46] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:11 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1222 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:11.981476 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-34ec51fa-518b-405e-976e-fa3446401797 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:12.003157 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-34ec51fa-518b-405e-976e-fa3446401797 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1241 microversion: 2.1 time: 0.467160 Aug 08 16:52:12.025336 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 21/47] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:11 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1241 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:12.271752 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8a85c5e6-f563-4c78-bf9e-353a79fa65d9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:12.272383 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8a85c5e6-f563-4c78-bf9e-353a79fa65d9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:12.284652 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8a85c5e6-f563-4c78-bf9e-353a79fa65d9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:12.285066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8a85c5e6-f563-4c78-bf9e-353a79fa65d9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:12.285511 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8a85c5e6-f563-4c78-bf9e-353a79fa65d9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:12.286228 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8a85c5e6-f563-4c78-bf9e-353a79fa65d9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:12.319966 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8a85c5e6-f563-4c78-bf9e-353a79fa65d9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:12.321277 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8a85c5e6-f563-4c78-bf9e-353a79fa65d9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:12.677841 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-173fff9c-c515-486f-a265-bf5e1310b0de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:12.679165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-173fff9c-c515-486f-a265-bf5e1310b0de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:12.843310 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8a85c5e6-f563-4c78-bf9e-353a79fa65d9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:12.873338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8a85c5e6-f563-4c78-bf9e-353a79fa65d9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1267 microversion: 2.1 time: 0.605939 Aug 08 16:52:12.879469 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 27/48] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:12 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1267 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:12.896754 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1559463564", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "666863c6-3645-478a-b5a7-f526e7cb7a76"}], "security_groups": [{"name": "tempest-securitygroup--670484810"}], "key_name": "tempest-keypair-1704036561", "user_data": "}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:13.403573 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.network.neutron [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] validate_networks() for [('666863c6-3645-478a-b5a7-f526e7cb7a76', None, None, None, None, None)] {{(pid=130235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:52:13.587855 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-173fff9c-c515-486f-a265-bf5e1310b0de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:13.596949 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-173fff9c-c515-486f-a265-bf5e1310b0de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1222 microversion: 2.1 time: 0.923311 Aug 08 16:52:13.603731 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 22/49] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:12 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1222 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:13.628177 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-61f5264b-f77b-4ba8-a72f-097aaa490270 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:13.629029 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-61f5264b-f77b-4ba8-a72f-097aaa490270 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:13.638262 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-61f5264b-f77b-4ba8-a72f-097aaa490270 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:13.639080 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-61f5264b-f77b-4ba8-a72f-097aaa490270 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:13.639864 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-61f5264b-f77b-4ba8-a72f-097aaa490270 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:13.641088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-61f5264b-f77b-4ba8-a72f-097aaa490270 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:13.641760 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-61f5264b-f77b-4ba8-a72f-097aaa490270 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:13.642556 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-61f5264b-f77b-4ba8-a72f-097aaa490270 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:14.058509 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-61f5264b-f77b-4ba8-a72f-097aaa490270 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:14.086139 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-61f5264b-f77b-4ba8-a72f-097aaa490270 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1245 microversion: 2.1 time: 0.481057 Aug 08 16:52:14.090769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 23/50] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:13 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1245 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:14.102828 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-05c3a81a-87fe-4b72-ab90-9c67c2c5a7b2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:14.103777 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-05c3a81a-87fe-4b72-ab90-9c67c2c5a7b2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:14.126717 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-05c3a81a-87fe-4b72-ab90-9c67c2c5a7b2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:14.126717 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-05c3a81a-87fe-4b72-ab90-9c67c2c5a7b2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:14.126717 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-05c3a81a-87fe-4b72-ab90-9c67c2c5a7b2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:14.132404 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-05c3a81a-87fe-4b72-ab90-9c67c2c5a7b2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:14.133908 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-05c3a81a-87fe-4b72-ab90-9c67c2c5a7b2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:14.136283 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-05c3a81a-87fe-4b72-ab90-9c67c2c5a7b2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:14.358108 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-05c3a81a-87fe-4b72-ab90-9c67c2c5a7b2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:14.380172 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-05c3a81a-87fe-4b72-ab90-9c67c2c5a7b2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1273 microversion: 2.1 time: 0.285814 Aug 08 16:52:14.380775 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 24/51] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:14 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:14.625439 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-18a5fc08-b771-4ce7-8881-fb4cf9eec4d3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:14.630142 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-18a5fc08-b771-4ce7-8881-fb4cf9eec4d3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:14.637320 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-18a5fc08-b771-4ce7-8881-fb4cf9eec4d3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:14.640306 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-18a5fc08-b771-4ce7-8881-fb4cf9eec4d3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:14.644699 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-18a5fc08-b771-4ce7-8881-fb4cf9eec4d3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:14.656216 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-18a5fc08-b771-4ce7-8881-fb4cf9eec4d3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:14.673905 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-18a5fc08-b771-4ce7-8881-fb4cf9eec4d3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:14.678272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-18a5fc08-b771-4ce7-8881-fb4cf9eec4d3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:15.054297 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-18a5fc08-b771-4ce7-8881-fb4cf9eec4d3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:15.077854 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-18a5fc08-b771-4ce7-8881-fb4cf9eec4d3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1282 microversion: 2.1 time: 0.444200 Aug 08 16:52:15.105371 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 25/52] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:14 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1282 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:15.127169 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-192422c4-7a79-45ec-a948-a70dce4bd1b2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:15.132006 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-192422c4-7a79-45ec-a948-a70dce4bd1b2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:15.228477 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-192422c4-7a79-45ec-a948-a70dce4bd1b2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:15.228477 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-192422c4-7a79-45ec-a948-a70dce4bd1b2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:15.228477 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-192422c4-7a79-45ec-a948-a70dce4bd1b2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:15.228477 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-192422c4-7a79-45ec-a948-a70dce4bd1b2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:15.229706 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-192422c4-7a79-45ec-a948-a70dce4bd1b2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:15.229706 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-192422c4-7a79-45ec-a948-a70dce4bd1b2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:15.347573 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-192422c4-7a79-45ec-a948-a70dce4bd1b2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:15.385115 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-192422c4-7a79-45ec-a948-a70dce4bd1b2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1293 microversion: 2.1 time: 0.258310 Aug 08 16:52:15.388135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 26/53] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:15 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1293 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:15.416859 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-542c4866-f6d7-492b-940d-f15b3128e536 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:15.420698 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-542c4866-f6d7-492b-940d-f15b3128e536 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:15.447852 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-542c4866-f6d7-492b-940d-f15b3128e536 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:15.451240 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-542c4866-f6d7-492b-940d-f15b3128e536 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:15.451975 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-542c4866-f6d7-492b-940d-f15b3128e536 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:15.454105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-542c4866-f6d7-492b-940d-f15b3128e536 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:15.456758 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-542c4866-f6d7-492b-940d-f15b3128e536 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:15.457402 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-542c4866-f6d7-492b-940d-f15b3128e536 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:15.649501 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-542c4866-f6d7-492b-940d-f15b3128e536 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:15.659883 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-542c4866-f6d7-492b-940d-f15b3128e536 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1273 microversion: 2.1 time: 0.259679 Aug 08 16:52:15.663324 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 27/54] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:15 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:16.115280 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5415e740-1d86-468d-b859-33c9ff914148 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:16.115924 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5415e740-1d86-468d-b859-33c9ff914148 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:16.123386 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5415e740-1d86-468d-b859-33c9ff914148 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:16.123867 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5415e740-1d86-468d-b859-33c9ff914148 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:16.128083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5415e740-1d86-468d-b859-33c9ff914148 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:16.129063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5415e740-1d86-468d-b859-33c9ff914148 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:16.129716 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5415e740-1d86-468d-b859-33c9ff914148 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:16.130310 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5415e740-1d86-468d-b859-33c9ff914148 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:16.169914 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Flavor limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:52:16.170690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Image limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:52:16.171631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Flavor pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:52:16.172297 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Image pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:52:16.172921 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:52:16.196208 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:16.197487 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:16.197608 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:16.198262 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:16.198756 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:16.199188 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:16.257146 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Getting quotas for project 442f2ca88fce4cbab9c01278239b77ce. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:52:16.282872 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Getting quotas for user 5a8db3ff64ca44958fd633ba25ee191f and project 442f2ca88fce4cbab9c01278239b77ce. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:52:16.302204 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Going to run 1 instances... {{(pid=130235) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:52:16.304456 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:52:16.494107 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-5415e740-1d86-468d-b859-33c9ff914148 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:16.505632 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5415e740-1d86-468d-b859-33c9ff914148 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1280 microversion: 2.1 time: 0.391773 Aug 08 16:52:16.526881 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 28/55] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:16 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1280 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:16.541854 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-166dfb5d-cd28-4f94-a8fe-425ab632d172 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:16.549104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-166dfb5d-cd28-4f94-a8fe-425ab632d172 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:16.572261 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-166dfb5d-cd28-4f94-a8fe-425ab632d172 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:16.579156 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-166dfb5d-cd28-4f94-a8fe-425ab632d172 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:16.579824 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-166dfb5d-cd28-4f94-a8fe-425ab632d172 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:16.580354 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-eb9d9529-40ca-4b72-bd8b-cc515b90241b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.696492 Aug 08 16:52:16.580593 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-166dfb5d-cd28-4f94-a8fe-425ab632d172 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:16.584784 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 28/56] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:52:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 3704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 16:52:16.589103 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-166dfb5d-cd28-4f94-a8fe-425ab632d172 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:16.592219 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-166dfb5d-cd28-4f94-a8fe-425ab632d172 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:16.607695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9930c4d6-236e-480d-a1fe-7016eb97c4c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:16.611386 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9930c4d6-236e-480d-a1fe-7016eb97c4c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:16.855033 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-166dfb5d-cd28-4f94-a8fe-425ab632d172 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:16.864764 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-166dfb5d-cd28-4f94-a8fe-425ab632d172 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1311 microversion: 2.1 time: 0.336327 Aug 08 16:52:16.891645 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 29/57] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:16 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1311 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:16.932907 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-bd9d48ec-64c4-4d93-b61a-01086b6c88c9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:16.933527 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-bd9d48ec-64c4-4d93-b61a-01086b6c88c9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:16.994060 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bd9d48ec-64c4-4d93-b61a-01086b6c88c9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:16.994609 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bd9d48ec-64c4-4d93-b61a-01086b6c88c9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:17.001703 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9930c4d6-236e-480d-a1fe-7016eb97c4c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:17.016359 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9930c4d6-236e-480d-a1fe-7016eb97c4c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1238 microversion: 2.1 time: 0.427270 Aug 08 16:52:17.017879 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bd9d48ec-64c4-4d93-b61a-01086b6c88c9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:17.018659 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bd9d48ec-64c4-4d93-b61a-01086b6c88c9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:17.019265 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bd9d48ec-64c4-4d93-b61a-01086b6c88c9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:17.019639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bd9d48ec-64c4-4d93-b61a-01086b6c88c9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:17.021361 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 29/58] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:16 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1238 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:17.299788 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bd9d48ec-64c4-4d93-b61a-01086b6c88c9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:17.315507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-bd9d48ec-64c4-4d93-b61a-01086b6c88c9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1273 microversion: 2.1 time: 0.422456 Aug 08 16:52:17.316167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 30/59] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:16 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1273 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:17.537258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ae8471de-9d34-47e6-8d4a-d74a195251a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:17.541941 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ae8471de-9d34-47e6-8d4a-d74a195251a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:17.550865 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae8471de-9d34-47e6-8d4a-d74a195251a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:17.552195 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae8471de-9d34-47e6-8d4a-d74a195251a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:17.571295 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae8471de-9d34-47e6-8d4a-d74a195251a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:17.571295 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae8471de-9d34-47e6-8d4a-d74a195251a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:17.571295 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae8471de-9d34-47e6-8d4a-d74a195251a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:17.571295 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae8471de-9d34-47e6-8d4a-d74a195251a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:17.870806 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ae8471de-9d34-47e6-8d4a-d74a195251a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:17.891137 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ae8471de-9d34-47e6-8d4a-d74a195251a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1280 microversion: 2.1 time: 0.351828 Aug 08 16:52:17.892941 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 30/60] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:17 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1280 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:17.910736 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ffb4fb62-c419-4cc4-9839-c1f35c9feb5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:17.911354 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ffb4fb62-c419-4cc4-9839-c1f35c9feb5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:17.947554 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ffb4fb62-c419-4cc4-9839-c1f35c9feb5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:17.947770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ffb4fb62-c419-4cc4-9839-c1f35c9feb5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:17.954992 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ffb4fb62-c419-4cc4-9839-c1f35c9feb5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:17.957569 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ffb4fb62-c419-4cc4-9839-c1f35c9feb5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:17.958247 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ffb4fb62-c419-4cc4-9839-c1f35c9feb5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:17.960110 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ffb4fb62-c419-4cc4-9839-c1f35c9feb5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:18.044970 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5abba62a-f465-43c5-a906-7f34254ef170 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:18.045755 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5abba62a-f465-43c5-a906-7f34254ef170 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:18.129548 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ffb4fb62-c419-4cc4-9839-c1f35c9feb5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:18.145520 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ffb4fb62-c419-4cc4-9839-c1f35c9feb5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1299 microversion: 2.1 time: 0.251459 Aug 08 16:52:18.167700 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 31/61] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:17 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1299 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:18.294239 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5abba62a-f465-43c5-a906-7f34254ef170 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:18.306398 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5abba62a-f465-43c5-a906-7f34254ef170 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1238 microversion: 2.1 time: 0.265809 Aug 08 16:52:18.311070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 31/62] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:18 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1238 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:18.357994 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-10a38fcd-aebb-4fc2-962e-67eb313ec208 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:18.357994 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-10a38fcd-aebb-4fc2-962e-67eb313ec208 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:18.357994 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-10a38fcd-aebb-4fc2-962e-67eb313ec208 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:18.357994 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-10a38fcd-aebb-4fc2-962e-67eb313ec208 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:18.358970 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-10a38fcd-aebb-4fc2-962e-67eb313ec208 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:18.358970 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-10a38fcd-aebb-4fc2-962e-67eb313ec208 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:18.358970 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-10a38fcd-aebb-4fc2-962e-67eb313ec208 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:18.362490 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-10a38fcd-aebb-4fc2-962e-67eb313ec208 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:18.938555 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-166a5b5d-72cb-44de-97dd-bf22b07b89b7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:18.940011 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-166a5b5d-72cb-44de-97dd-bf22b07b89b7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:18.961874 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-166a5b5d-72cb-44de-97dd-bf22b07b89b7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:18.961874 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-166a5b5d-72cb-44de-97dd-bf22b07b89b7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:18.961874 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-166a5b5d-72cb-44de-97dd-bf22b07b89b7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:18.961874 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-166a5b5d-72cb-44de-97dd-bf22b07b89b7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:18.962246 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-166a5b5d-72cb-44de-97dd-bf22b07b89b7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:18.962246 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-166a5b5d-72cb-44de-97dd-bf22b07b89b7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:19.153716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-166a5b5d-72cb-44de-97dd-bf22b07b89b7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:19.165688 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-166a5b5d-72cb-44de-97dd-bf22b07b89b7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1280 microversion: 2.1 time: 0.255771 Aug 08 16:52:19.179125 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 32/63] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:18 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1280 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:19.190013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e9e51692-b39f-4826-9dc8-a6a4364eac8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:19.191024 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e9e51692-b39f-4826-9dc8-a6a4364eac8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:19.205769 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e9e51692-b39f-4826-9dc8-a6a4364eac8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:19.206333 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e9e51692-b39f-4826-9dc8-a6a4364eac8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:19.206801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e9e51692-b39f-4826-9dc8-a6a4364eac8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:19.207713 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e9e51692-b39f-4826-9dc8-a6a4364eac8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:19.208463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e9e51692-b39f-4826-9dc8-a6a4364eac8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:19.209054 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e9e51692-b39f-4826-9dc8-a6a4364eac8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:19.470388 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-10a38fcd-aebb-4fc2-962e-67eb313ec208 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:19.470388 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-10a38fcd-aebb-4fc2-962e-67eb313ec208 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 1.121315 Aug 08 16:52:19.470388 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 32/64] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:18 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:19.470388 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-bc652dc8-7dab-41b8-a898-e29125020cba tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:19.471302 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-bc652dc8-7dab-41b8-a898-e29125020cba tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:19.471302 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:19.471302 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bc652dc8-7dab-41b8-a898-e29125020cba tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:19.471302 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bc652dc8-7dab-41b8-a898-e29125020cba tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:19.471610 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bc652dc8-7dab-41b8-a898-e29125020cba tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:19.485729 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e9e51692-b39f-4826-9dc8-a6a4364eac8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:19.498758 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bc652dc8-7dab-41b8-a898-e29125020cba tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:19.499719 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e9e51692-b39f-4826-9dc8-a6a4364eac8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1299 microversion: 2.1 time: 0.314080 Aug 08 16:52:19.500988 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bc652dc8-7dab-41b8-a898-e29125020cba tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:19.501426 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bc652dc8-7dab-41b8-a898-e29125020cba tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:19.506604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 33/65] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:19 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1299 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:19.607533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bc652dc8-7dab-41b8-a898-e29125020cba tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:19.615755 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-bc652dc8-7dab-41b8-a898-e29125020cba tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1242 microversion: 2.1 time: 0.158220 Aug 08 16:52:19.616613 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 33/66] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:19 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:20.312367 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-860c5e75-88a2-4bc1-ac73-4736e7fa0b08 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:20.312367 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-860c5e75-88a2-4bc1-ac73-4736e7fa0b08 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:20.312367 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-860c5e75-88a2-4bc1-ac73-4736e7fa0b08 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:20.312367 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-860c5e75-88a2-4bc1-ac73-4736e7fa0b08 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:20.314651 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-860c5e75-88a2-4bc1-ac73-4736e7fa0b08 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:20.314651 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-860c5e75-88a2-4bc1-ac73-4736e7fa0b08 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:20.314651 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-860c5e75-88a2-4bc1-ac73-4736e7fa0b08 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:20.314651 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-860c5e75-88a2-4bc1-ac73-4736e7fa0b08 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:20.513298 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a7d8ebce-07bd-495f-8ef0-a8942a5e5497 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:20.519913 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a7d8ebce-07bd-495f-8ef0-a8942a5e5497 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:20.587516 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a7d8ebce-07bd-495f-8ef0-a8942a5e5497 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:20.592154 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a7d8ebce-07bd-495f-8ef0-a8942a5e5497 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:20.598464 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a7d8ebce-07bd-495f-8ef0-a8942a5e5497 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:20.602430 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a7d8ebce-07bd-495f-8ef0-a8942a5e5497 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:20.611911 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a7d8ebce-07bd-495f-8ef0-a8942a5e5497 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:20.616468 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a7d8ebce-07bd-495f-8ef0-a8942a5e5497 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:21.138478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=6 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:21.735171 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-860c5e75-88a2-4bc1-ac73-4736e7fa0b08 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:21.759654 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-860c5e75-88a2-4bc1-ac73-4736e7fa0b08 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 1.570244 Aug 08 16:52:21.813472 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 34/67] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:20 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:21.848025 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-345aa17d-0250-4f84-a4be-40940bc9b776 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:21.850584 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-345aa17d-0250-4f84-a4be-40940bc9b776 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:21.865414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-345aa17d-0250-4f84-a4be-40940bc9b776 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:21.866523 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-345aa17d-0250-4f84-a4be-40940bc9b776 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:21.868221 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-345aa17d-0250-4f84-a4be-40940bc9b776 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:21.869828 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-345aa17d-0250-4f84-a4be-40940bc9b776 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:21.871093 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-345aa17d-0250-4f84-a4be-40940bc9b776 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:21.872016 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-345aa17d-0250-4f84-a4be-40940bc9b776 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:21.885466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a7d8ebce-07bd-495f-8ef0-a8942a5e5497 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:21.933352 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a7d8ebce-07bd-495f-8ef0-a8942a5e5497 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 1.437592 Aug 08 16:52:21.954930 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 34/68] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:20 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:22.291208 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-b74e587c-cf82-4135-85d3-ec50dbe82187 req-9e118999-0689-471e-9d80-1322e73eaccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65990fbf-4d36-42ed-8f3b-3406d373841a", "tag": "aa00f426-38ee-4d32-8b5a-c76a247b3988"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:22.341336 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-b74e587c-cf82-4135-85d3-ec50dbe82187 req-9e118999-0689-471e-9d80-1322e73eaccd service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:22.341336 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-b74e587c-cf82-4135-85d3-ec50dbe82187 req-9e118999-0689-471e-9d80-1322e73eaccd service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:22.341336 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-b74e587c-cf82-4135-85d3-ec50dbe82187 req-9e118999-0689-471e-9d80-1322e73eaccd service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:22.450385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-b74e587c-cf82-4135-85d3-ec50dbe82187 req-9e118999-0689-471e-9d80-1322e73eaccd service nova] Creating event network-changed:aa00f426-38ee-4d32-8b5a-c76a247b3988 for instance 65990fbf-4d36-42ed-8f3b-3406d373841a on hv-cinder-85220 Aug 08 16:52:22.450385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-b74e587c-cf82-4135-85d3-ec50dbe82187 req-9e118999-0689-471e-9d80-1322e73eaccd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=130236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 16:52:22.450876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-b74e587c-cf82-4135-85d3-ec50dbe82187 req-9e118999-0689-471e-9d80-1322e73eaccd service nova] Acquired lock "compute-rpcapi-router" {{(pid=130236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 16:52:22.458128 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b81c45d3-2a29-4290-b4a0-e67a0a2bae04 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:22.460810 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b81c45d3-2a29-4290-b4a0-e67a0a2bae04 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:22.463807 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b81c45d3-2a29-4290-b4a0-e67a0a2bae04 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:22.468738 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b81c45d3-2a29-4290-b4a0-e67a0a2bae04 None None] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:22.471038 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b81c45d3-2a29-4290-b4a0-e67a0a2bae04 None None] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:22.485136 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b81c45d3-2a29-4290-b4a0-e67a0a2bae04 None None] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:22.557047 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.compute.rpcapi [None req-b81c45d3-2a29-4290-b4a0-e67a0a2bae04 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 16:52:22.562345 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b81c45d3-2a29-4290-b4a0-e67a0a2bae04 None None] Releasing lock "compute-rpcapi-router" {{(pid=130236) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 16:52:22.689174 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b81c45d3-2a29-4290-b4a0-e67a0a2bae04 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.731299 Aug 08 16:52:22.691268 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 35/69] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:22.713364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-86bcafed-49cb-44d4-bd54-363db029c13f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:22.738398 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-86bcafed-49cb-44d4-bd54-363db029c13f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:22.804350 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86bcafed-49cb-44d4-bd54-363db029c13f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:22.805726 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86bcafed-49cb-44d4-bd54-363db029c13f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:22.813063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86bcafed-49cb-44d4-bd54-363db029c13f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:22.818741 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86bcafed-49cb-44d4-bd54-363db029c13f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:22.824619 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86bcafed-49cb-44d4-bd54-363db029c13f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:22.827157 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86bcafed-49cb-44d4-bd54-363db029c13f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:23.392927 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-345aa17d-0250-4f84-a4be-40940bc9b776 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:23.411667 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-345aa17d-0250-4f84-a4be-40940bc9b776 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 1.582342 Aug 08 16:52:23.412260 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 35/70] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:21 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:23.592739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=30 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:23.744668 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-44a23ea9-9e0f-451d-872b-63f39a506abb req-f2e80cf3-99f6-4dfa-88f5-dac034c2cb63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9c648c-c4ed-45bc-8333-5f0646d9e6eb", "tag": "c16259a2-eb59-46c3-b743-600832fe35f7"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:23.775466 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-44a23ea9-9e0f-451d-872b-63f39a506abb req-f2e80cf3-99f6-4dfa-88f5-dac034c2cb63 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:23.775963 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-44a23ea9-9e0f-451d-872b-63f39a506abb req-f2e80cf3-99f6-4dfa-88f5-dac034c2cb63 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:23.776404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-44a23ea9-9e0f-451d-872b-63f39a506abb req-f2e80cf3-99f6-4dfa-88f5-dac034c2cb63 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:23.834071 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-44a23ea9-9e0f-451d-872b-63f39a506abb req-f2e80cf3-99f6-4dfa-88f5-dac034c2cb63 service nova] Creating event network-changed:c16259a2-eb59-46c3-b743-600832fe35f7 for instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb on hv-cinder-85220 Aug 08 16:52:23.838666 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-44a23ea9-9e0f-451d-872b-63f39a506abb req-f2e80cf3-99f6-4dfa-88f5-dac034c2cb63 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=130235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 16:52:23.838666 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-44a23ea9-9e0f-451d-872b-63f39a506abb req-f2e80cf3-99f6-4dfa-88f5-dac034c2cb63 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 16:52:23.839542 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-55ce4f94-d428-4f85-9082-7020b169f843 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:23.840066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-55ce4f94-d428-4f85-9082-7020b169f843 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:23.840514 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-55ce4f94-d428-4f85-9082-7020b169f843 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:23.841304 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-55ce4f94-d428-4f85-9082-7020b169f843 None None] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:23.841774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-55ce4f94-d428-4f85-9082-7020b169f843 None None] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:23.842198 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-55ce4f94-d428-4f85-9082-7020b169f843 None None] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:23.863075 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.compute.rpcapi [None req-55ce4f94-d428-4f85-9082-7020b169f843 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 16:52:23.878360 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-55ce4f94-d428-4f85-9082-7020b169f843 None None] Releasing lock "compute-rpcapi-router" {{(pid=130235) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 16:52:23.921414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-55ce4f94-d428-4f85-9082-7020b169f843 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.500566 Aug 08 16:52:23.922694 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 36/71] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:23.928523 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b5faf422-d95a-493a-a087-b2e51699e083 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:23.932035 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b5faf422-d95a-493a-a087-b2e51699e083 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:23.946852 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b5faf422-d95a-493a-a087-b2e51699e083 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:23.954203 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b5faf422-d95a-493a-a087-b2e51699e083 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:23.955112 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b5faf422-d95a-493a-a087-b2e51699e083 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:23.956139 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b5faf422-d95a-493a-a087-b2e51699e083 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:23.956852 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b5faf422-d95a-493a-a087-b2e51699e083 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:23.957497 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b5faf422-d95a-493a-a087-b2e51699e083 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:23.970964 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-86bcafed-49cb-44d4-bd54-363db029c13f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:24.022395 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-86bcafed-49cb-44d4-bd54-363db029c13f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1298 microversion: 2.1 time: 1.319718 Aug 08 16:52:24.028505 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 36/72] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:22 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1298 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:24.071404 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-85605cc4-7a11-4614-ade4-c2fbcd4e78d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:24.071404 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-85605cc4-7a11-4614-ade4-c2fbcd4e78d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:24.110538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-85605cc4-7a11-4614-ade4-c2fbcd4e78d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:24.111232 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-85605cc4-7a11-4614-ade4-c2fbcd4e78d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:24.111915 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-85605cc4-7a11-4614-ade4-c2fbcd4e78d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:24.112735 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-85605cc4-7a11-4614-ade4-c2fbcd4e78d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:24.116034 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-85605cc4-7a11-4614-ade4-c2fbcd4e78d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:24.116618 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-85605cc4-7a11-4614-ade4-c2fbcd4e78d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:24.475886 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b5faf422-d95a-493a-a087-b2e51699e083 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:24.493482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b5faf422-d95a-493a-a087-b2e51699e083 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.569207 Aug 08 16:52:24.494459 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 37/73] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:23 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:24.507914 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-03d24117-2a78-4aca-814b-b8564c6f109f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:24.509044 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-03d24117-2a78-4aca-814b-b8564c6f109f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:24.515819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-03d24117-2a78-4aca-814b-b8564c6f109f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:24.522087 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-03d24117-2a78-4aca-814b-b8564c6f109f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:24.522944 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-03d24117-2a78-4aca-814b-b8564c6f109f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:24.524477 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-03d24117-2a78-4aca-814b-b8564c6f109f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:24.525211 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-03d24117-2a78-4aca-814b-b8564c6f109f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:24.525900 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-03d24117-2a78-4aca-814b-b8564c6f109f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:24.918743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-03d24117-2a78-4aca-814b-b8564c6f109f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:24.931413 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-03d24117-2a78-4aca-814b-b8564c6f109f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.432843 Aug 08 16:52:24.932226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 38/74] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:24 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:25.044939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8cf288ac-21d2-4cb7-919e-ad823877eb39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:25.045687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8cf288ac-21d2-4cb7-919e-ad823877eb39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:25.060525 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8cf288ac-21d2-4cb7-919e-ad823877eb39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:25.061810 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8cf288ac-21d2-4cb7-919e-ad823877eb39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:25.063117 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8cf288ac-21d2-4cb7-919e-ad823877eb39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:25.065153 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8cf288ac-21d2-4cb7-919e-ad823877eb39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:25.071890 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8cf288ac-21d2-4cb7-919e-ad823877eb39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:25.077645 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8cf288ac-21d2-4cb7-919e-ad823877eb39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:25.309093 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-85605cc4-7a11-4614-ade4-c2fbcd4e78d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:25.324987 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-85605cc4-7a11-4614-ade4-c2fbcd4e78d7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 1.287150 Aug 08 16:52:25.344333 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 37/75] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:24 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:25.357907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8cf288ac-21d2-4cb7-919e-ad823877eb39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:25.367581 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8cf288ac-21d2-4cb7-919e-ad823877eb39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1296 microversion: 2.1 time: 0.326982 Aug 08 16:52:25.369375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 39/76] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:25 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1296 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:25.550344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c2e31d24-79f0-4dba-a2b2-c3440649dccd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:25.551815 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c2e31d24-79f0-4dba-a2b2-c3440649dccd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:25.575636 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c2e31d24-79f0-4dba-a2b2-c3440649dccd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:25.575636 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c2e31d24-79f0-4dba-a2b2-c3440649dccd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:25.576167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c2e31d24-79f0-4dba-a2b2-c3440649dccd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:25.577032 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c2e31d24-79f0-4dba-a2b2-c3440649dccd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:25.578073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c2e31d24-79f0-4dba-a2b2-c3440649dccd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:25.578255 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c2e31d24-79f0-4dba-a2b2-c3440649dccd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:25.654813 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-60c1fbd8-04af-4341-a5b5-08fc03cf3bc6 req-c9d78139-280a-4dd1-816f-5e79f23f693c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0affcec-8e4c-461a-ac29-5ac8d4fd92bd", "tag": "412ef6d6-1ffe-43de-9f26-f0beb2a5afac"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:25.723812 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-60c1fbd8-04af-4341-a5b5-08fc03cf3bc6 req-c9d78139-280a-4dd1-816f-5e79f23f693c service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:25.726988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-60c1fbd8-04af-4341-a5b5-08fc03cf3bc6 req-c9d78139-280a-4dd1-816f-5e79f23f693c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:25.726988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-60c1fbd8-04af-4341-a5b5-08fc03cf3bc6 req-c9d78139-280a-4dd1-816f-5e79f23f693c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:25.766233 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-60c1fbd8-04af-4341-a5b5-08fc03cf3bc6 req-c9d78139-280a-4dd1-816f-5e79f23f693c service nova] Creating event network-changed:412ef6d6-1ffe-43de-9f26-f0beb2a5afac for instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd on hv-cinder-85220 Aug 08 16:52:25.786138 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-60c1fbd8-04af-4341-a5b5-08fc03cf3bc6 req-c9d78139-280a-4dd1-816f-5e79f23f693c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156392 Aug 08 16:52:25.797122 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 40/77] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:26.001463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-909e96e7-b026-4a76-a6e2-3095d87d43bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:26.001463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-909e96e7-b026-4a76-a6e2-3095d87d43bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:26.001463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-909e96e7-b026-4a76-a6e2-3095d87d43bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:26.001463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-909e96e7-b026-4a76-a6e2-3095d87d43bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:26.003372 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-909e96e7-b026-4a76-a6e2-3095d87d43bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:26.003372 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-909e96e7-b026-4a76-a6e2-3095d87d43bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:26.003372 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-909e96e7-b026-4a76-a6e2-3095d87d43bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:26.003372 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-909e96e7-b026-4a76-a6e2-3095d87d43bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:26.003909 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c2e31d24-79f0-4dba-a2b2-c3440649dccd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:26.009884 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=100 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:26.014157 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c2e31d24-79f0-4dba-a2b2-c3440649dccd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.472873 Aug 08 16:52:26.015422 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 38/78] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:25 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:26.021419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-badb6b91-a44a-4d7f-8dd3-9f74487590a1 req-9c353122-b6f5-4c30-82ee-32bdcd905e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f523b07-1c20-4eab-a270-2e16b2895c14", "tag": "5f8c4a44-04d1-4ab7-bf9b-3e4a84483e8e"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:26.033161 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-badb6b91-a44a-4d7f-8dd3-9f74487590a1 req-9c353122-b6f5-4c30-82ee-32bdcd905e7b service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:26.034222 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-badb6b91-a44a-4d7f-8dd3-9f74487590a1 req-9c353122-b6f5-4c30-82ee-32bdcd905e7b service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:26.034957 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-badb6b91-a44a-4d7f-8dd3-9f74487590a1 req-9c353122-b6f5-4c30-82ee-32bdcd905e7b service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:26.048033 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-badb6b91-a44a-4d7f-8dd3-9f74487590a1 req-9c353122-b6f5-4c30-82ee-32bdcd905e7b service nova] Creating event network-changed:5f8c4a44-04d1-4ab7-bf9b-3e4a84483e8e for instance 9f523b07-1c20-4eab-a270-2e16b2895c14 on hv-cinder-85220 Aug 08 16:52:26.057181 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-badb6b91-a44a-4d7f-8dd3-9f74487590a1 req-9c353122-b6f5-4c30-82ee-32bdcd905e7b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037843 Aug 08 16:52:26.058154 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 39/79] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:26.180383 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-909e96e7-b026-4a76-a6e2-3095d87d43bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:26.188517 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-909e96e7-b026-4a76-a6e2-3095d87d43bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.234641 Aug 08 16:52:26.189111 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 41/80] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:25 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:26.354931 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fe4a6cc0-5e34-4a51-bacd-27c0fa796d88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:26.367028 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fe4a6cc0-5e34-4a51-bacd-27c0fa796d88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:26.367028 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fe4a6cc0-5e34-4a51-bacd-27c0fa796d88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:26.367028 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fe4a6cc0-5e34-4a51-bacd-27c0fa796d88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:26.367028 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fe4a6cc0-5e34-4a51-bacd-27c0fa796d88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:26.369482 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fe4a6cc0-5e34-4a51-bacd-27c0fa796d88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:26.370113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fe4a6cc0-5e34-4a51-bacd-27c0fa796d88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:26.371059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fe4a6cc0-5e34-4a51-bacd-27c0fa796d88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:26.392485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4d0369c1-887a-499e-a829-6ced2f76c4ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:26.395628 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4d0369c1-887a-499e-a829-6ced2f76c4ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:26.401235 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4d0369c1-887a-499e-a829-6ced2f76c4ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:26.401722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4d0369c1-887a-499e-a829-6ced2f76c4ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:26.402187 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4d0369c1-887a-499e-a829-6ced2f76c4ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:26.403567 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4d0369c1-887a-499e-a829-6ced2f76c4ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:26.404175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4d0369c1-887a-499e-a829-6ced2f76c4ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:26.404745 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4d0369c1-887a-499e-a829-6ced2f76c4ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:26.481876 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4d0369c1-887a-499e-a829-6ced2f76c4ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:26.495497 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4d0369c1-887a-499e-a829-6ced2f76c4ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1296 microversion: 2.1 time: 0.106941 Aug 08 16:52:26.496870 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 42/81] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:26 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:26.633309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fe4a6cc0-5e34-4a51-bacd-27c0fa796d88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:26.644496 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fe4a6cc0-5e34-4a51-bacd-27c0fa796d88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.296089 Aug 08 16:52:26.645673 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 40/82] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:26 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:27.043421 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-be191951-b7be-41ea-88c5-1ee962f97300 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:27.045212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-be191951-b7be-41ea-88c5-1ee962f97300 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:27.053977 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:27.056458 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-be191951-b7be-41ea-88c5-1ee962f97300 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:27.059498 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-be191951-b7be-41ea-88c5-1ee962f97300 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:27.059498 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-be191951-b7be-41ea-88c5-1ee962f97300 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:27.059498 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-be191951-b7be-41ea-88c5-1ee962f97300 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:27.059498 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-be191951-b7be-41ea-88c5-1ee962f97300 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:27.059927 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-be191951-b7be-41ea-88c5-1ee962f97300 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:27.204305 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-be191951-b7be-41ea-88c5-1ee962f97300 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:27.211752 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0a051356-a26e-47c5-851f-8a6ba6ebe78e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:27.212393 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0a051356-a26e-47c5-851f-8a6ba6ebe78e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:27.213576 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-be191951-b7be-41ea-88c5-1ee962f97300 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.177232 Aug 08 16:52:27.214178 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 43/83] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:27 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:27.218977 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0a051356-a26e-47c5-851f-8a6ba6ebe78e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:27.219477 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0a051356-a26e-47c5-851f-8a6ba6ebe78e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:27.219914 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0a051356-a26e-47c5-851f-8a6ba6ebe78e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:27.220624 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0a051356-a26e-47c5-851f-8a6ba6ebe78e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:27.221229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0a051356-a26e-47c5-851f-8a6ba6ebe78e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:27.221657 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0a051356-a26e-47c5-851f-8a6ba6ebe78e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:27.417199 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0a051356-a26e-47c5-851f-8a6ba6ebe78e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:27.426418 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0a051356-a26e-47c5-851f-8a6ba6ebe78e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.220180 Aug 08 16:52:27.427059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 41/84] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:27 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:27.520557 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9334b703-aa81-4e89-aed9-c386c5c234a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:27.522425 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9334b703-aa81-4e89-aed9-c386c5c234a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:27.540881 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9334b703-aa81-4e89-aed9-c386c5c234a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:27.547108 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9334b703-aa81-4e89-aed9-c386c5c234a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:27.547108 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9334b703-aa81-4e89-aed9-c386c5c234a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:27.547108 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9334b703-aa81-4e89-aed9-c386c5c234a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:27.547108 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9334b703-aa81-4e89-aed9-c386c5c234a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:27.547596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9334b703-aa81-4e89-aed9-c386c5c234a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:27.675393 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e82ae657-3160-49fb-8115-ea26e323012b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:27.676302 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e82ae657-3160-49fb-8115-ea26e323012b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:27.684765 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e82ae657-3160-49fb-8115-ea26e323012b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:27.686270 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e82ae657-3160-49fb-8115-ea26e323012b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:27.687140 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e82ae657-3160-49fb-8115-ea26e323012b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:27.688254 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e82ae657-3160-49fb-8115-ea26e323012b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:27.689019 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e82ae657-3160-49fb-8115-ea26e323012b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:27.690402 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e82ae657-3160-49fb-8115-ea26e323012b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:27.817588 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9334b703-aa81-4e89-aed9-c386c5c234a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:27.832242 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9334b703-aa81-4e89-aed9-c386c5c234a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.317710 Aug 08 16:52:27.848339 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 44/85] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:27 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:28.170711 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e82ae657-3160-49fb-8115-ea26e323012b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:28.170711 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e82ae657-3160-49fb-8115-ea26e323012b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.320243 Aug 08 16:52:28.170711 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 42/86] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:27 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:28.241556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-603b9f2f-df0e-44f2-afa3-b3176fdbb63a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:28.241556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-603b9f2f-df0e-44f2-afa3-b3176fdbb63a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:28.242755 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-603b9f2f-df0e-44f2-afa3-b3176fdbb63a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:28.243628 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-603b9f2f-df0e-44f2-afa3-b3176fdbb63a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:28.244076 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-603b9f2f-df0e-44f2-afa3-b3176fdbb63a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:28.245108 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-603b9f2f-df0e-44f2-afa3-b3176fdbb63a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:28.245559 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-603b9f2f-df0e-44f2-afa3-b3176fdbb63a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:28.245968 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-603b9f2f-df0e-44f2-afa3-b3176fdbb63a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:28.301660 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=26 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:28.406894 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-603b9f2f-df0e-44f2-afa3-b3176fdbb63a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:28.417953 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-603b9f2f-df0e-44f2-afa3-b3176fdbb63a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.187201 Aug 08 16:52:28.419554 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 45/87] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:28 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:28.454873 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2a23117f-1130-4b89-974d-f0d6e0863e26 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:28.458458 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2a23117f-1130-4b89-974d-f0d6e0863e26 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:28.467738 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2a23117f-1130-4b89-974d-f0d6e0863e26 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:28.468938 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2a23117f-1130-4b89-974d-f0d6e0863e26 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:28.469905 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2a23117f-1130-4b89-974d-f0d6e0863e26 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:28.471411 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2a23117f-1130-4b89-974d-f0d6e0863e26 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:28.477699 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2a23117f-1130-4b89-974d-f0d6e0863e26 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:28.478778 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2a23117f-1130-4b89-974d-f0d6e0863e26 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:28.839504 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2a23117f-1130-4b89-974d-f0d6e0863e26 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:28.867882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-07179abf-b22b-4486-b6ec-7a7b66e19948 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:28.873858 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2a23117f-1130-4b89-974d-f0d6e0863e26 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.425353 Aug 08 16:52:28.874634 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 43/88] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:28 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:28.875927 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-07179abf-b22b-4486-b6ec-7a7b66e19948 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:28.915351 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07179abf-b22b-4486-b6ec-7a7b66e19948 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:28.916502 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07179abf-b22b-4486-b6ec-7a7b66e19948 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:28.917874 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07179abf-b22b-4486-b6ec-7a7b66e19948 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:28.932982 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07179abf-b22b-4486-b6ec-7a7b66e19948 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:28.933658 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07179abf-b22b-4486-b6ec-7a7b66e19948 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:28.934131 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07179abf-b22b-4486-b6ec-7a7b66e19948 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:29.180620 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-52acbf01-3362-4440-8185-2cfb97fa5f81 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:29.181765 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-52acbf01-3362-4440-8185-2cfb97fa5f81 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:29.229319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52acbf01-3362-4440-8185-2cfb97fa5f81 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:29.229319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52acbf01-3362-4440-8185-2cfb97fa5f81 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:29.229319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52acbf01-3362-4440-8185-2cfb97fa5f81 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:29.229319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52acbf01-3362-4440-8185-2cfb97fa5f81 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:29.231032 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52acbf01-3362-4440-8185-2cfb97fa5f81 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:29.231032 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52acbf01-3362-4440-8185-2cfb97fa5f81 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:29.271482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-07179abf-b22b-4486-b6ec-7a7b66e19948 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:29.277826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=100 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:29.284916 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-07179abf-b22b-4486-b6ec-7a7b66e19948 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.432351 Aug 08 16:52:29.286141 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 46/89] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:28 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:29.460343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0f615953-fc7f-45d7-bed0-15432b8152e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:29.461533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0f615953-fc7f-45d7-bed0-15432b8152e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:29.480300 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f615953-fc7f-45d7-bed0-15432b8152e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:29.480733 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f615953-fc7f-45d7-bed0-15432b8152e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:29.481222 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f615953-fc7f-45d7-bed0-15432b8152e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:29.481919 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f615953-fc7f-45d7-bed0-15432b8152e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:29.482713 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f615953-fc7f-45d7-bed0-15432b8152e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:29.483148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f615953-fc7f-45d7-bed0-15432b8152e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:29.495059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-52acbf01-3362-4440-8185-2cfb97fa5f81 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:29.507226 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-52acbf01-3362-4440-8185-2cfb97fa5f81 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.336623 Aug 08 16:52:29.509632 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 44/90] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:29 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:29.696592 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0f615953-fc7f-45d7-bed0-15432b8152e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:29.707095 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0f615953-fc7f-45d7-bed0-15432b8152e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.252808 Aug 08 16:52:29.708177 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 47/91] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:29 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:29.906051 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3b51c65b-4c0d-46df-b042-d47c40efdd71 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:29.906695 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3b51c65b-4c0d-46df-b042-d47c40efdd71 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:29.913401 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3b51c65b-4c0d-46df-b042-d47c40efdd71 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:29.914675 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3b51c65b-4c0d-46df-b042-d47c40efdd71 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:29.915289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3b51c65b-4c0d-46df-b042-d47c40efdd71 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:29.916295 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3b51c65b-4c0d-46df-b042-d47c40efdd71 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:29.917468 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3b51c65b-4c0d-46df-b042-d47c40efdd71 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:29.917468 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3b51c65b-4c0d-46df-b042-d47c40efdd71 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:30.113065 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3b51c65b-4c0d-46df-b042-d47c40efdd71 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:30.121518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3b51c65b-4c0d-46df-b042-d47c40efdd71 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.219463 Aug 08 16:52:30.122141 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 45/92] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:29 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:30.306932 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-deb9431c-a8b0-48e5-935d-b1a6282480c4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:30.307606 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-deb9431c-a8b0-48e5-935d-b1a6282480c4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:30.315805 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-deb9431c-a8b0-48e5-935d-b1a6282480c4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:30.316306 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-deb9431c-a8b0-48e5-935d-b1a6282480c4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:30.316750 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-deb9431c-a8b0-48e5-935d-b1a6282480c4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:30.317459 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-deb9431c-a8b0-48e5-935d-b1a6282480c4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:30.317914 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-deb9431c-a8b0-48e5-935d-b1a6282480c4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:30.318393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-deb9431c-a8b0-48e5-935d-b1a6282480c4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:30.549220 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a2827382-122a-4793-9478-1fb14395b167 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:30.550287 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a2827382-122a-4793-9478-1fb14395b167 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:30.551211 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-deb9431c-a8b0-48e5-935d-b1a6282480c4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:30.561005 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a2827382-122a-4793-9478-1fb14395b167 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:30.561847 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a2827382-122a-4793-9478-1fb14395b167 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:30.562394 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a2827382-122a-4793-9478-1fb14395b167 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:30.563348 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a2827382-122a-4793-9478-1fb14395b167 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:30.564063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a2827382-122a-4793-9478-1fb14395b167 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:30.564618 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a2827382-122a-4793-9478-1fb14395b167 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:30.572909 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-deb9431c-a8b0-48e5-935d-b1a6282480c4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.270834 Aug 08 16:52:30.573956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 48/93] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:30 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:30.746934 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f22ab8e1-6536-4dd0-9988-c8f3629a5b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:30.748417 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f22ab8e1-6536-4dd0-9988-c8f3629a5b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:30.760138 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f22ab8e1-6536-4dd0-9988-c8f3629a5b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:30.761332 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f22ab8e1-6536-4dd0-9988-c8f3629a5b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:30.762086 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f22ab8e1-6536-4dd0-9988-c8f3629a5b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:30.763578 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f22ab8e1-6536-4dd0-9988-c8f3629a5b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:30.764650 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f22ab8e1-6536-4dd0-9988-c8f3629a5b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:30.765407 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f22ab8e1-6536-4dd0-9988-c8f3629a5b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:30.766741 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a2827382-122a-4793-9478-1fb14395b167 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:30.779100 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a2827382-122a-4793-9478-1fb14395b167 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.236511 Aug 08 16:52:30.782748 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 46/94] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:30 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:30.989790 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f22ab8e1-6536-4dd0-9988-c8f3629a5b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:30.999625 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f22ab8e1-6536-4dd0-9988-c8f3629a5b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.260863 Aug 08 16:52:31.000431 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 49/95] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:30 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:31.145382 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0ac1e1d2-0d19-46da-9f05-5974fabc2f87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:31.146235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0ac1e1d2-0d19-46da-9f05-5974fabc2f87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:31.154055 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ac1e1d2-0d19-46da-9f05-5974fabc2f87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:31.154695 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ac1e1d2-0d19-46da-9f05-5974fabc2f87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:31.155367 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ac1e1d2-0d19-46da-9f05-5974fabc2f87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:31.156344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ac1e1d2-0d19-46da-9f05-5974fabc2f87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:31.156901 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ac1e1d2-0d19-46da-9f05-5974fabc2f87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:31.157505 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ac1e1d2-0d19-46da-9f05-5974fabc2f87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:31.311066 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0ac1e1d2-0d19-46da-9f05-5974fabc2f87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:31.319533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0ac1e1d2-0d19-46da-9f05-5974fabc2f87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.178716 Aug 08 16:52:31.320644 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 47/96] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:31 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:31.598976 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e5dbfc9a-3ddf-4a02-aa1d-62c438c8000f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:31.601823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e5dbfc9a-3ddf-4a02-aa1d-62c438c8000f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:31.627171 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e5dbfc9a-3ddf-4a02-aa1d-62c438c8000f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:31.628790 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e5dbfc9a-3ddf-4a02-aa1d-62c438c8000f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:31.630123 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e5dbfc9a-3ddf-4a02-aa1d-62c438c8000f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:31.631585 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e5dbfc9a-3ddf-4a02-aa1d-62c438c8000f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:31.633767 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e5dbfc9a-3ddf-4a02-aa1d-62c438c8000f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:31.635223 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e5dbfc9a-3ddf-4a02-aa1d-62c438c8000f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:31.823850 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-668bf697-f3e9-4f02-a6fa-a4d9f33eec88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:31.826331 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-668bf697-f3e9-4f02-a6fa-a4d9f33eec88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:31.839772 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-668bf697-f3e9-4f02-a6fa-a4d9f33eec88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:31.843160 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-668bf697-f3e9-4f02-a6fa-a4d9f33eec88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:31.845296 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-668bf697-f3e9-4f02-a6fa-a4d9f33eec88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:31.846513 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-668bf697-f3e9-4f02-a6fa-a4d9f33eec88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:31.848221 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-668bf697-f3e9-4f02-a6fa-a4d9f33eec88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:31.849306 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-668bf697-f3e9-4f02-a6fa-a4d9f33eec88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:31.944588 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e5dbfc9a-3ddf-4a02-aa1d-62c438c8000f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:31.965170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e5dbfc9a-3ddf-4a02-aa1d-62c438c8000f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.372972 Aug 08 16:52:31.967157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 50/97] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:31 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:32.022692 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7de873d6-a0c4-431e-a5da-c04103171fdc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:32.023779 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7de873d6-a0c4-431e-a5da-c04103171fdc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:32.040049 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7de873d6-a0c4-431e-a5da-c04103171fdc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:32.040768 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7de873d6-a0c4-431e-a5da-c04103171fdc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:32.041377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7de873d6-a0c4-431e-a5da-c04103171fdc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:32.042282 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7de873d6-a0c4-431e-a5da-c04103171fdc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:32.043005 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7de873d6-a0c4-431e-a5da-c04103171fdc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:32.043632 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7de873d6-a0c4-431e-a5da-c04103171fdc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:32.210449 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-668bf697-f3e9-4f02-a6fa-a4d9f33eec88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:32.228549 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-668bf697-f3e9-4f02-a6fa-a4d9f33eec88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.416030 Aug 08 16:52:32.230002 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 48/98] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:31 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:32.326427 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7de873d6-a0c4-431e-a5da-c04103171fdc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:32.363424 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7de873d6-a0c4-431e-a5da-c04103171fdc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.314330 Aug 08 16:52:32.363424 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 51/99] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:32 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:32.363587 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f62d2f7c-cbbb-4059-a3e2-4d30a70d7afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:32.363587 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f62d2f7c-cbbb-4059-a3e2-4d30a70d7afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:32.363587 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f62d2f7c-cbbb-4059-a3e2-4d30a70d7afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:32.363587 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f62d2f7c-cbbb-4059-a3e2-4d30a70d7afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:32.363911 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f62d2f7c-cbbb-4059-a3e2-4d30a70d7afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:32.363911 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f62d2f7c-cbbb-4059-a3e2-4d30a70d7afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:32.363911 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f62d2f7c-cbbb-4059-a3e2-4d30a70d7afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:32.363911 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f62d2f7c-cbbb-4059-a3e2-4d30a70d7afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:32.640978 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f62d2f7c-cbbb-4059-a3e2-4d30a70d7afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:32.652205 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f62d2f7c-cbbb-4059-a3e2-4d30a70d7afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.313030 Aug 08 16:52:32.653432 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 49/100] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:32 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:32.994426 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e5318da8-e89c-45ce-8025-95d03c13ea8f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:32.995285 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e5318da8-e89c-45ce-8025-95d03c13ea8f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:33.012711 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e5318da8-e89c-45ce-8025-95d03c13ea8f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:33.012711 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e5318da8-e89c-45ce-8025-95d03c13ea8f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:33.013323 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e5318da8-e89c-45ce-8025-95d03c13ea8f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:33.014932 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e5318da8-e89c-45ce-8025-95d03c13ea8f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:33.016589 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e5318da8-e89c-45ce-8025-95d03c13ea8f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:33.017821 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e5318da8-e89c-45ce-8025-95d03c13ea8f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:33.272226 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d7aea51e-51da-484e-bf85-7b6ad98f4375 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:33.276355 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d7aea51e-51da-484e-bf85-7b6ad98f4375 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:33.293159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:33.303709 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7aea51e-51da-484e-bf85-7b6ad98f4375 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:33.307143 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7aea51e-51da-484e-bf85-7b6ad98f4375 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:33.308474 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7aea51e-51da-484e-bf85-7b6ad98f4375 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:33.309990 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7aea51e-51da-484e-bf85-7b6ad98f4375 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:33.311283 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7aea51e-51da-484e-bf85-7b6ad98f4375 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:33.312561 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7aea51e-51da-484e-bf85-7b6ad98f4375 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:33.377478 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e5318da8-e89c-45ce-8025-95d03c13ea8f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:33.389989 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e5318da8-e89c-45ce-8025-95d03c13ea8f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.397929 Aug 08 16:52:33.391224 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 52/101] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:32 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:33.400026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-81c6f8cf-6033-4893-af48-f9d3eb45b289 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:33.400643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-81c6f8cf-6033-4893-af48-f9d3eb45b289 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:33.408958 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81c6f8cf-6033-4893-af48-f9d3eb45b289 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:33.422858 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81c6f8cf-6033-4893-af48-f9d3eb45b289 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:33.422858 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81c6f8cf-6033-4893-af48-f9d3eb45b289 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:33.422858 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81c6f8cf-6033-4893-af48-f9d3eb45b289 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:33.422858 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81c6f8cf-6033-4893-af48-f9d3eb45b289 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:33.423546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81c6f8cf-6033-4893-af48-f9d3eb45b289 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:33.644589 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-81c6f8cf-6033-4893-af48-f9d3eb45b289 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:33.657280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-81c6f8cf-6033-4893-af48-f9d3eb45b289 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.263118 Aug 08 16:52:33.658498 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 53/102] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:33 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:33.688660 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-68f0f26e-af50-489c-a6bf-0cc2421acb63 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:33.691675 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-68f0f26e-af50-489c-a6bf-0cc2421acb63 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:33.697525 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-68f0f26e-af50-489c-a6bf-0cc2421acb63 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:33.698706 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-68f0f26e-af50-489c-a6bf-0cc2421acb63 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:33.699179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-68f0f26e-af50-489c-a6bf-0cc2421acb63 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:33.699916 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-68f0f26e-af50-489c-a6bf-0cc2421acb63 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:33.700475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-68f0f26e-af50-489c-a6bf-0cc2421acb63 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:33.700894 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-68f0f26e-af50-489c-a6bf-0cc2421acb63 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:33.722301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d7aea51e-51da-484e-bf85-7b6ad98f4375 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:33.734436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d7aea51e-51da-484e-bf85-7b6ad98f4375 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.472100 Aug 08 16:52:33.746168 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 50/103] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:33 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:33.861634 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=6 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:33.914437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-68f0f26e-af50-489c-a6bf-0cc2421acb63 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:33.943886 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-68f0f26e-af50-489c-a6bf-0cc2421acb63 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.262764 Aug 08 16:52:33.949579 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 54/104] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:33 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:34.307901 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-1477bc84-17b1-4fa5-9c42-166949ca0590 req-e6a926b0-2ee3-4ba4-80ab-648421e08445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba167d3-4013-4e79-8c84-5a72b458b6f7", "tag": "adc434bf-69d7-4da9-9eea-f961d0824299"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:34.319188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-1477bc84-17b1-4fa5-9c42-166949ca0590 req-e6a926b0-2ee3-4ba4-80ab-648421e08445 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:34.319660 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-1477bc84-17b1-4fa5-9c42-166949ca0590 req-e6a926b0-2ee3-4ba4-80ab-648421e08445 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:34.320883 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-1477bc84-17b1-4fa5-9c42-166949ca0590 req-e6a926b0-2ee3-4ba4-80ab-648421e08445 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:34.341069 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-1477bc84-17b1-4fa5-9c42-166949ca0590 req-e6a926b0-2ee3-4ba4-80ab-648421e08445 service nova] Creating event network-changed:adc434bf-69d7-4da9-9eea-f961d0824299 for instance cba167d3-4013-4e79-8c84-5a72b458b6f7 on hv-cinder-85220 Aug 08 16:52:34.350189 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-1477bc84-17b1-4fa5-9c42-166949ca0590 req-e6a926b0-2ee3-4ba4-80ab-648421e08445 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048173 Aug 08 16:52:34.351133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 51/105] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:34.441286 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e67c2de0-1f94-467c-b4f4-16d821f7c4a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:34.441286 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e67c2de0-1f94-467c-b4f4-16d821f7c4a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:34.449221 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e67c2de0-1f94-467c-b4f4-16d821f7c4a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:34.450404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e67c2de0-1f94-467c-b4f4-16d821f7c4a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:34.451408 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e67c2de0-1f94-467c-b4f4-16d821f7c4a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:34.453187 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e67c2de0-1f94-467c-b4f4-16d821f7c4a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:34.454142 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e67c2de0-1f94-467c-b4f4-16d821f7c4a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:34.455053 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e67c2de0-1f94-467c-b4f4-16d821f7c4a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:34.651278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e67c2de0-1f94-467c-b4f4-16d821f7c4a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:34.659683 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e67c2de0-1f94-467c-b4f4-16d821f7c4a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.238531 Aug 08 16:52:34.660285 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 55/106] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:34 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:34.698100 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3da93a91-a43a-4704-b594-241fd2a20f6b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:34.698927 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3da93a91-a43a-4704-b594-241fd2a20f6b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:34.707926 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3da93a91-a43a-4704-b594-241fd2a20f6b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:34.707926 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3da93a91-a43a-4704-b594-241fd2a20f6b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:34.707926 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3da93a91-a43a-4704-b594-241fd2a20f6b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:34.708771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3da93a91-a43a-4704-b594-241fd2a20f6b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:34.709381 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3da93a91-a43a-4704-b594-241fd2a20f6b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:34.710102 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3da93a91-a43a-4704-b594-241fd2a20f6b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:34.760430 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4b10d3e7-dff4-437b-b4c9-f0eff121b3f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:34.761559 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4b10d3e7-dff4-437b-b4c9-f0eff121b3f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:34.771428 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4b10d3e7-dff4-437b-b4c9-f0eff121b3f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:34.771987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4b10d3e7-dff4-437b-b4c9-f0eff121b3f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:34.772641 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4b10d3e7-dff4-437b-b4c9-f0eff121b3f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:34.774451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4b10d3e7-dff4-437b-b4c9-f0eff121b3f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:34.780838 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4b10d3e7-dff4-437b-b4c9-f0eff121b3f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:34.780838 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4b10d3e7-dff4-437b-b4c9-f0eff121b3f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:35.056022 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4b10d3e7-dff4-437b-b4c9-f0eff121b3f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:35.074248 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4b10d3e7-dff4-437b-b4c9-f0eff121b3f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.319592 Aug 08 16:52:35.091595 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 56/107] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:34 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:35.106167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1c2336bc-44d3-4b84-bdb7-80331be887d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:35.107468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1c2336bc-44d3-4b84-bdb7-80331be887d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:35.116543 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1c2336bc-44d3-4b84-bdb7-80331be887d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:35.119659 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1c2336bc-44d3-4b84-bdb7-80331be887d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:35.119659 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1c2336bc-44d3-4b84-bdb7-80331be887d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:35.121169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1c2336bc-44d3-4b84-bdb7-80331be887d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:35.122001 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1c2336bc-44d3-4b84-bdb7-80331be887d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:35.123042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1c2336bc-44d3-4b84-bdb7-80331be887d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:35.179173 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3da93a91-a43a-4704-b594-241fd2a20f6b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:35.193656 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3da93a91-a43a-4704-b594-241fd2a20f6b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.501254 Aug 08 16:52:35.194382 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 52/108] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:34 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:35.351837 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1c2336bc-44d3-4b84-bdb7-80331be887d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:35.360326 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1c2336bc-44d3-4b84-bdb7-80331be887d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.266942 Aug 08 16:52:35.360936 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 57/109] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:35 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:35.691261 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-682fd84c-eaec-4e15-8d05-577a5af16266 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:35.692176 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-682fd84c-eaec-4e15-8d05-577a5af16266 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:35.700658 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-682fd84c-eaec-4e15-8d05-577a5af16266 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:35.703184 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-682fd84c-eaec-4e15-8d05-577a5af16266 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:35.703184 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-682fd84c-eaec-4e15-8d05-577a5af16266 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:35.703184 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-682fd84c-eaec-4e15-8d05-577a5af16266 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:35.703184 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-682fd84c-eaec-4e15-8d05-577a5af16266 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:35.703690 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-682fd84c-eaec-4e15-8d05-577a5af16266 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:35.883900 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-682fd84c-eaec-4e15-8d05-577a5af16266 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:35.892478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-682fd84c-eaec-4e15-8d05-577a5af16266 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.207379 Aug 08 16:52:35.893389 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 53/110] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:35 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:36.117229 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-926cc3a3-4df2-43a4-b859-8bd45feedbf9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:36.117965 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-926cc3a3-4df2-43a4-b859-8bd45feedbf9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:36.125148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-926cc3a3-4df2-43a4-b859-8bd45feedbf9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:36.125770 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-926cc3a3-4df2-43a4-b859-8bd45feedbf9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:36.126213 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-926cc3a3-4df2-43a4-b859-8bd45feedbf9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:36.127113 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-926cc3a3-4df2-43a4-b859-8bd45feedbf9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:36.127416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-926cc3a3-4df2-43a4-b859-8bd45feedbf9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:36.127878 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-926cc3a3-4df2-43a4-b859-8bd45feedbf9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:36.219230 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b7df24eb-06a7-496a-ad81-b96674140161 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:36.220410 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b7df24eb-06a7-496a-ad81-b96674140161 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:36.230832 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b7df24eb-06a7-496a-ad81-b96674140161 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:36.231769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b7df24eb-06a7-496a-ad81-b96674140161 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:36.232547 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b7df24eb-06a7-496a-ad81-b96674140161 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:36.233880 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b7df24eb-06a7-496a-ad81-b96674140161 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:36.234975 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b7df24eb-06a7-496a-ad81-b96674140161 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:36.235817 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b7df24eb-06a7-496a-ad81-b96674140161 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:36.294737 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-926cc3a3-4df2-43a4-b859-8bd45feedbf9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:36.320739 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-926cc3a3-4df2-43a4-b859-8bd45feedbf9 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.209711 Aug 08 16:52:36.322780 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 58/111] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:36 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:36.390621 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c8b4e10b-b4fd-4885-80ab-efdc052e3aed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:36.393963 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c8b4e10b-b4fd-4885-80ab-efdc052e3aed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:36.407921 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c8b4e10b-b4fd-4885-80ab-efdc052e3aed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:36.409579 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c8b4e10b-b4fd-4885-80ab-efdc052e3aed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:36.410203 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c8b4e10b-b4fd-4885-80ab-efdc052e3aed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:36.419814 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c8b4e10b-b4fd-4885-80ab-efdc052e3aed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:36.420749 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c8b4e10b-b4fd-4885-80ab-efdc052e3aed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:36.421521 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c8b4e10b-b4fd-4885-80ab-efdc052e3aed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:36.518043 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b7df24eb-06a7-496a-ad81-b96674140161 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:36.539451 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b7df24eb-06a7-496a-ad81-b96674140161 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.324606 Aug 08 16:52:36.561144 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 54/112] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:36 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:36.674978 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c8b4e10b-b4fd-4885-80ab-efdc052e3aed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:36.685526 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c8b4e10b-b4fd-4885-80ab-efdc052e3aed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.304270 Aug 08 16:52:36.686340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 59/113] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:36 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:36.916976 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ed46c015-144f-41c4-95dd-6ed61336e936 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:36.918072 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ed46c015-144f-41c4-95dd-6ed61336e936 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:36.927289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ed46c015-144f-41c4-95dd-6ed61336e936 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:36.928046 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ed46c015-144f-41c4-95dd-6ed61336e936 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:36.929034 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ed46c015-144f-41c4-95dd-6ed61336e936 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:36.931144 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ed46c015-144f-41c4-95dd-6ed61336e936 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:36.932187 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ed46c015-144f-41c4-95dd-6ed61336e936 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:36.933136 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ed46c015-144f-41c4-95dd-6ed61336e936 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:37.157255 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ed46c015-144f-41c4-95dd-6ed61336e936 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:37.165574 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ed46c015-144f-41c4-95dd-6ed61336e936 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.255309 Aug 08 16:52:37.166169 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 55/114] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:36 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:37.356028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f7811aee-8064-432c-90c6-8eaff8cd149c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:37.356621 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f7811aee-8064-432c-90c6-8eaff8cd149c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:37.362756 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7811aee-8064-432c-90c6-8eaff8cd149c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:37.363249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7811aee-8064-432c-90c6-8eaff8cd149c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:37.363688 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7811aee-8064-432c-90c6-8eaff8cd149c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:37.364370 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7811aee-8064-432c-90c6-8eaff8cd149c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:37.364818 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7811aee-8064-432c-90c6-8eaff8cd149c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:37.365235 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7811aee-8064-432c-90c6-8eaff8cd149c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:37.501482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f7811aee-8064-432c-90c6-8eaff8cd149c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:37.508849 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f7811aee-8064-432c-90c6-8eaff8cd149c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.156936 Aug 08 16:52:37.509466 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 60/115] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:37 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:37.583225 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-91b12cff-d151-41e2-ab52-d4659072c2c7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:37.583949 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-91b12cff-d151-41e2-ab52-d4659072c2c7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:37.589967 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-91b12cff-d151-41e2-ab52-d4659072c2c7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:37.592736 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-91b12cff-d151-41e2-ab52-d4659072c2c7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:37.592736 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-91b12cff-d151-41e2-ab52-d4659072c2c7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:37.592736 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-91b12cff-d151-41e2-ab52-d4659072c2c7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:37.592736 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-91b12cff-d151-41e2-ab52-d4659072c2c7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:37.593130 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-91b12cff-d151-41e2-ab52-d4659072c2c7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:37.707883 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fcec1e73-8fdc-4fe9-9744-39d627c686ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:37.708836 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fcec1e73-8fdc-4fe9-9744-39d627c686ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:37.715012 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fcec1e73-8fdc-4fe9-9744-39d627c686ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:37.715497 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fcec1e73-8fdc-4fe9-9744-39d627c686ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:37.715924 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fcec1e73-8fdc-4fe9-9744-39d627c686ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:37.716615 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fcec1e73-8fdc-4fe9-9744-39d627c686ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:37.717059 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fcec1e73-8fdc-4fe9-9744-39d627c686ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:37.717476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fcec1e73-8fdc-4fe9-9744-39d627c686ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:37.723254 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-91b12cff-d151-41e2-ab52-d4659072c2c7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:37.727426 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=100 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:37.731747 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-91b12cff-d151-41e2-ab52-d4659072c2c7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.152362 Aug 08 16:52:37.732328 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 56/116] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:37 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:37.850251 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fcec1e73-8fdc-4fe9-9744-39d627c686ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:37.858285 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fcec1e73-8fdc-4fe9-9744-39d627c686ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.154294 Aug 08 16:52:37.858888 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 61/117] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:37 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:38.185970 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-dc7a907b-1227-47c3-9d07-4eae0925b27c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:38.186867 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-dc7a907b-1227-47c3-9d07-4eae0925b27c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:38.204216 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc7a907b-1227-47c3-9d07-4eae0925b27c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:38.210131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc7a907b-1227-47c3-9d07-4eae0925b27c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:38.210131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc7a907b-1227-47c3-9d07-4eae0925b27c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:38.210131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc7a907b-1227-47c3-9d07-4eae0925b27c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:38.213264 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc7a907b-1227-47c3-9d07-4eae0925b27c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:38.215608 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc7a907b-1227-47c3-9d07-4eae0925b27c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:38.535899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-35faae1d-f8d0-453e-b9da-c5ea7097aa85 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:38.536839 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-35faae1d-f8d0-453e-b9da-c5ea7097aa85 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:38.554977 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-35faae1d-f8d0-453e-b9da-c5ea7097aa85 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:38.560409 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-35faae1d-f8d0-453e-b9da-c5ea7097aa85 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:38.562652 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-35faae1d-f8d0-453e-b9da-c5ea7097aa85 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:38.563833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-35faae1d-f8d0-453e-b9da-c5ea7097aa85 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:38.564779 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-35faae1d-f8d0-453e-b9da-c5ea7097aa85 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:38.568080 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-35faae1d-f8d0-453e-b9da-c5ea7097aa85 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:38.684448 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-dc7a907b-1227-47c3-9d07-4eae0925b27c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:38.692994 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-dc7a907b-1227-47c3-9d07-4eae0925b27c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.510994 Aug 08 16:52:38.695773 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 57/118] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:38 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:38.756016 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-75c41765-805e-4d26-8ff2-a144dbb798a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:38.758870 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-75c41765-805e-4d26-8ff2-a144dbb798a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:38.770447 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-75c41765-805e-4d26-8ff2-a144dbb798a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:38.771549 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-75c41765-805e-4d26-8ff2-a144dbb798a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:38.772697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-75c41765-805e-4d26-8ff2-a144dbb798a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:38.775194 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-75c41765-805e-4d26-8ff2-a144dbb798a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:38.776927 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-75c41765-805e-4d26-8ff2-a144dbb798a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:38.777208 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-75c41765-805e-4d26-8ff2-a144dbb798a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:38.837796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-35faae1d-f8d0-453e-b9da-c5ea7097aa85 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:38.848030 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-35faae1d-f8d0-453e-b9da-c5ea7097aa85 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.320345 Aug 08 16:52:38.848710 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 62/119] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:38 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:38.887613 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f4b94101-6d02-45f1-b9b2-6ceb63c12ce9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:38.889138 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f4b94101-6d02-45f1-b9b2-6ceb63c12ce9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:38.901355 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f4b94101-6d02-45f1-b9b2-6ceb63c12ce9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:38.902883 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f4b94101-6d02-45f1-b9b2-6ceb63c12ce9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:38.903926 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f4b94101-6d02-45f1-b9b2-6ceb63c12ce9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:38.905536 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f4b94101-6d02-45f1-b9b2-6ceb63c12ce9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:38.906651 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f4b94101-6d02-45f1-b9b2-6ceb63c12ce9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:38.907649 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f4b94101-6d02-45f1-b9b2-6ceb63c12ce9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:38.983226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=100 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:39.048675 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-75c41765-805e-4d26-8ff2-a144dbb798a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:39.061681 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-75c41765-805e-4d26-8ff2-a144dbb798a9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.312492 Aug 08 16:52:39.078784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 58/120] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:38 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:39.180828 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f4b94101-6d02-45f1-b9b2-6ceb63c12ce9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:39.192917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f4b94101-6d02-45f1-b9b2-6ceb63c12ce9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.315848 Aug 08 16:52:39.193885 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 63/121] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:38 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:39.729257 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0c034c76-7474-4585-997f-d28dcf148606 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:39.732120 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0c034c76-7474-4585-997f-d28dcf148606 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:39.741737 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0c034c76-7474-4585-997f-d28dcf148606 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:39.743083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0c034c76-7474-4585-997f-d28dcf148606 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:39.743954 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0c034c76-7474-4585-997f-d28dcf148606 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:39.745317 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0c034c76-7474-4585-997f-d28dcf148606 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:39.746227 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0c034c76-7474-4585-997f-d28dcf148606 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:39.747339 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0c034c76-7474-4585-997f-d28dcf148606 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:39.898677 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-dd94dd33-a34d-43ad-8743-65602c2e81e6 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:39.898677 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-dd94dd33-a34d-43ad-8743-65602c2e81e6 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:39.927224 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd94dd33-a34d-43ad-8743-65602c2e81e6 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:39.928585 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd94dd33-a34d-43ad-8743-65602c2e81e6 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:39.931280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd94dd33-a34d-43ad-8743-65602c2e81e6 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:39.934013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd94dd33-a34d-43ad-8743-65602c2e81e6 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:39.935451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd94dd33-a34d-43ad-8743-65602c2e81e6 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:39.937293 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd94dd33-a34d-43ad-8743-65602c2e81e6 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:39.961896 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0c034c76-7474-4585-997f-d28dcf148606 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:39.982077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0c034c76-7474-4585-997f-d28dcf148606 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.259842 Aug 08 16:52:39.985204 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 59/122] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:39 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:40.094069 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a721e6d5-deef-41d9-a817-6ec225d91b55 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:40.097723 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a721e6d5-deef-41d9-a817-6ec225d91b55 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:40.107416 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a721e6d5-deef-41d9-a817-6ec225d91b55 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:40.108667 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a721e6d5-deef-41d9-a817-6ec225d91b55 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:40.109773 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a721e6d5-deef-41d9-a817-6ec225d91b55 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:40.111364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a721e6d5-deef-41d9-a817-6ec225d91b55 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:40.112465 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a721e6d5-deef-41d9-a817-6ec225d91b55 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:40.113553 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a721e6d5-deef-41d9-a817-6ec225d91b55 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:40.193332 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-dd94dd33-a34d-43ad-8743-65602c2e81e6 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:40.206316 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-dd94dd33-a34d-43ad-8743-65602c2e81e6 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.325285 Aug 08 16:52:40.209686 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 64/123] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:39 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:40.234128 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-561a6dbb-9e01-4ebc-938a-bd520a570feb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:40.239970 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-561a6dbb-9e01-4ebc-938a-bd520a570feb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:40.254422 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-561a6dbb-9e01-4ebc-938a-bd520a570feb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:40.256441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-561a6dbb-9e01-4ebc-938a-bd520a570feb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:40.256441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-561a6dbb-9e01-4ebc-938a-bd520a570feb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:40.258717 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-561a6dbb-9e01-4ebc-938a-bd520a570feb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:40.259532 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-561a6dbb-9e01-4ebc-938a-bd520a570feb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:40.262512 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-561a6dbb-9e01-4ebc-938a-bd520a570feb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:40.540281 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a721e6d5-deef-41d9-a817-6ec225d91b55 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:40.571501 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a721e6d5-deef-41d9-a817-6ec225d91b55 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.483287 Aug 08 16:52:40.571501 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 60/124] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:40 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:40.975393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-561a6dbb-9e01-4ebc-938a-bd520a570feb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:40.995859 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-561a6dbb-9e01-4ebc-938a-bd520a570feb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.767002 Aug 08 16:52:40.996935 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 65/125] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:40 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:41.009272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3bf90d12-22fd-4a43-b0ac-c368e50c01b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:41.010385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3bf90d12-22fd-4a43-b0ac-c368e50c01b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:41.020379 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3bf90d12-22fd-4a43-b0ac-c368e50c01b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:41.021034 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3bf90d12-22fd-4a43-b0ac-c368e50c01b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:41.021866 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3bf90d12-22fd-4a43-b0ac-c368e50c01b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:41.023390 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3bf90d12-22fd-4a43-b0ac-c368e50c01b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:41.023999 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3bf90d12-22fd-4a43-b0ac-c368e50c01b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:41.024558 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3bf90d12-22fd-4a43-b0ac-c368e50c01b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:41.250940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-31ec32b1-20cf-4c1f-bc32-33151030ab91 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:41.258980 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-31ec32b1-20cf-4c1f-bc32-33151030ab91 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:41.285062 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-31ec32b1-20cf-4c1f-bc32-33151030ab91 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:41.286111 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-31ec32b1-20cf-4c1f-bc32-33151030ab91 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:41.287057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-31ec32b1-20cf-4c1f-bc32-33151030ab91 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:41.288576 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-31ec32b1-20cf-4c1f-bc32-33151030ab91 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:41.290611 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-31ec32b1-20cf-4c1f-bc32-33151030ab91 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:41.291817 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-31ec32b1-20cf-4c1f-bc32-33151030ab91 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:41.426713 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3bf90d12-22fd-4a43-b0ac-c368e50c01b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:41.438502 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3bf90d12-22fd-4a43-b0ac-c368e50c01b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.434714 Aug 08 16:52:41.439897 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 61/126] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:41 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:41.591609 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1ea8b167-938f-4b1d-a029-a638c8c88c27 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:41.592917 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1ea8b167-938f-4b1d-a029-a638c8c88c27 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:41.601194 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1ea8b167-938f-4b1d-a029-a638c8c88c27 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:41.601722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1ea8b167-938f-4b1d-a029-a638c8c88c27 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:41.602485 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1ea8b167-938f-4b1d-a029-a638c8c88c27 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:41.603539 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1ea8b167-938f-4b1d-a029-a638c8c88c27 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:41.604013 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1ea8b167-938f-4b1d-a029-a638c8c88c27 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:41.604450 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1ea8b167-938f-4b1d-a029-a638c8c88c27 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:41.611636 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-31ec32b1-20cf-4c1f-bc32-33151030ab91 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:41.623724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-31ec32b1-20cf-4c1f-bc32-33151030ab91 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.382151 Aug 08 16:52:41.624698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 66/127] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:41 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:41.806865 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1ea8b167-938f-4b1d-a029-a638c8c88c27 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:41.822851 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1ea8b167-938f-4b1d-a029-a638c8c88c27 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.234770 Aug 08 16:52:41.846042 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 62/128] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:41 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:42.020384 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-65bab167-1e2f-4ae5-835c-b52bada792ae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:42.021349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-65bab167-1e2f-4ae5-835c-b52bada792ae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:42.040964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-65bab167-1e2f-4ae5-835c-b52bada792ae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:42.041640 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-65bab167-1e2f-4ae5-835c-b52bada792ae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:42.042258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-65bab167-1e2f-4ae5-835c-b52bada792ae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:42.043522 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-65bab167-1e2f-4ae5-835c-b52bada792ae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:42.044219 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-65bab167-1e2f-4ae5-835c-b52bada792ae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:42.060283 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-65bab167-1e2f-4ae5-835c-b52bada792ae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:42.407229 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-65bab167-1e2f-4ae5-835c-b52bada792ae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:42.423881 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-65bab167-1e2f-4ae5-835c-b52bada792ae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.408450 Aug 08 16:52:42.425300 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 67/129] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:42 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:42.481642 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e4e5d013-104e-4371-99c7-7d8ed30eabad tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:42.482670 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e4e5d013-104e-4371-99c7-7d8ed30eabad tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:42.493023 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4e5d013-104e-4371-99c7-7d8ed30eabad tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:42.493712 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4e5d013-104e-4371-99c7-7d8ed30eabad tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:42.494411 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4e5d013-104e-4371-99c7-7d8ed30eabad tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:42.495284 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4e5d013-104e-4371-99c7-7d8ed30eabad tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:42.495865 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4e5d013-104e-4371-99c7-7d8ed30eabad tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:42.496392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4e5d013-104e-4371-99c7-7d8ed30eabad tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:42.605618 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-c88989af-68ac-442e-aa67-ef9dbff99ba1 req-17e946d1-9631-4a36-80e6-d5fa4c5bdbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9c648c-c4ed-45bc-8333-5f0646d9e6eb", "name": "network-vif-plugged", "status": "completed", "tag": "c16259a2-eb59-46c3-b743-600832fe35f7"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:42.617312 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-c88989af-68ac-442e-aa67-ef9dbff99ba1 req-17e946d1-9631-4a36-80e6-d5fa4c5bdbaf service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:42.618128 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-c88989af-68ac-442e-aa67-ef9dbff99ba1 req-17e946d1-9631-4a36-80e6-d5fa4c5bdbaf service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:42.618676 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-c88989af-68ac-442e-aa67-ef9dbff99ba1 req-17e946d1-9631-4a36-80e6-d5fa4c5bdbaf service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:42.631632 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-c88989af-68ac-442e-aa67-ef9dbff99ba1 req-17e946d1-9631-4a36-80e6-d5fa4c5bdbaf service nova] Creating event network-vif-plugged:c16259a2-eb59-46c3-b743-600832fe35f7 for instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb on hv-cinder-85220 Aug 08 16:52:42.639228 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-c88989af-68ac-442e-aa67-ef9dbff99ba1 req-17e946d1-9631-4a36-80e6-d5fa4c5bdbaf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148450 Aug 08 16:52:42.639852 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 68/130] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:42.646479 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-cec8f04d-9358-464e-9984-822dd8bcd2ac tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:42.647413 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-cec8f04d-9358-464e-9984-822dd8bcd2ac tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:42.654614 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cec8f04d-9358-464e-9984-822dd8bcd2ac tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:42.655113 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cec8f04d-9358-464e-9984-822dd8bcd2ac tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:42.655731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cec8f04d-9358-464e-9984-822dd8bcd2ac tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:42.656452 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cec8f04d-9358-464e-9984-822dd8bcd2ac tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:42.657150 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cec8f04d-9358-464e-9984-822dd8bcd2ac tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:42.657573 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cec8f04d-9358-464e-9984-822dd8bcd2ac tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:42.688838 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e4e5d013-104e-4371-99c7-7d8ed30eabad tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:42.700232 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e4e5d013-104e-4371-99c7-7d8ed30eabad tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.227785 Aug 08 16:52:42.701154 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 63/131] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:42 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:42.824675 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-cec8f04d-9358-464e-9984-822dd8bcd2ac tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:42.832994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-cec8f04d-9358-464e-9984-822dd8bcd2ac tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.190756 Aug 08 16:52:42.833596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 69/132] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:42 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:42.851529 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-dfbe0529-a2ea-4522-a86f-66f4bb8416ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:42.852182 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-dfbe0529-a2ea-4522-a86f-66f4bb8416ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:42.858874 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dfbe0529-a2ea-4522-a86f-66f4bb8416ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:42.859294 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dfbe0529-a2ea-4522-a86f-66f4bb8416ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:42.859738 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dfbe0529-a2ea-4522-a86f-66f4bb8416ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:42.860460 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dfbe0529-a2ea-4522-a86f-66f4bb8416ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:42.860919 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dfbe0529-a2ea-4522-a86f-66f4bb8416ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:42.861347 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dfbe0529-a2ea-4522-a86f-66f4bb8416ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:43.022107 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-dfbe0529-a2ea-4522-a86f-66f4bb8416ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:43.031383 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-dfbe0529-a2ea-4522-a86f-66f4bb8416ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.183987 Aug 08 16:52:43.032151 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 64/133] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:42 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:43.457463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b89c5dc9-0831-412f-ac48-05a54eb982ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:43.466334 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b89c5dc9-0831-412f-ac48-05a54eb982ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:43.468178 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b89c5dc9-0831-412f-ac48-05a54eb982ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:43.468795 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b89c5dc9-0831-412f-ac48-05a54eb982ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:43.469335 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b89c5dc9-0831-412f-ac48-05a54eb982ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:43.470273 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b89c5dc9-0831-412f-ac48-05a54eb982ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:43.471378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b89c5dc9-0831-412f-ac48-05a54eb982ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:43.471901 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b89c5dc9-0831-412f-ac48-05a54eb982ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:43.644892 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b89c5dc9-0831-412f-ac48-05a54eb982ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:43.654080 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b89c5dc9-0831-412f-ac48-05a54eb982ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.209700 Aug 08 16:52:43.654704 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 70/134] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:43 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:43.723491 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-11850a8a-819e-49db-9fea-3fa0e06035c9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:43.724094 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-11850a8a-819e-49db-9fea-3fa0e06035c9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:43.731173 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-11850a8a-819e-49db-9fea-3fa0e06035c9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:43.731663 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-11850a8a-819e-49db-9fea-3fa0e06035c9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:43.732099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-11850a8a-819e-49db-9fea-3fa0e06035c9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:43.732819 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-11850a8a-819e-49db-9fea-3fa0e06035c9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:43.733272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-11850a8a-819e-49db-9fea-3fa0e06035c9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:43.733692 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-11850a8a-819e-49db-9fea-3fa0e06035c9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:43.859934 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9359dbf7-3aef-420e-86ff-01986c6462d1 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:43.861429 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9359dbf7-3aef-420e-86ff-01986c6462d1 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:43.871911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9359dbf7-3aef-420e-86ff-01986c6462d1 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:43.872568 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9359dbf7-3aef-420e-86ff-01986c6462d1 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:43.873280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9359dbf7-3aef-420e-86ff-01986c6462d1 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:43.874279 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9359dbf7-3aef-420e-86ff-01986c6462d1 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:43.874940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9359dbf7-3aef-420e-86ff-01986c6462d1 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:43.875463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9359dbf7-3aef-420e-86ff-01986c6462d1 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:43.897372 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-11850a8a-819e-49db-9fea-3fa0e06035c9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:43.906092 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-11850a8a-819e-49db-9fea-3fa0e06035c9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.186487 Aug 08 16:52:43.906975 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 65/135] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:43 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:44.056432 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9f2ff7f7-b863-44e9-ba61-1051a74f5ef0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:44.057065 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9f2ff7f7-b863-44e9-ba61-1051a74f5ef0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:44.063978 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9f2ff7f7-b863-44e9-ba61-1051a74f5ef0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:44.064474 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9f2ff7f7-b863-44e9-ba61-1051a74f5ef0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:44.064913 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9f2ff7f7-b863-44e9-ba61-1051a74f5ef0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:44.065644 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9f2ff7f7-b863-44e9-ba61-1051a74f5ef0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:44.066100 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9f2ff7f7-b863-44e9-ba61-1051a74f5ef0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:44.066526 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9f2ff7f7-b863-44e9-ba61-1051a74f5ef0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:44.071015 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9359dbf7-3aef-420e-86ff-01986c6462d1 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:44.085034 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9359dbf7-3aef-420e-86ff-01986c6462d1 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.232272 Aug 08 16:52:44.086139 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 71/136] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:43 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:44.221419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9f2ff7f7-b863-44e9-ba61-1051a74f5ef0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:44.229845 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9f2ff7f7-b863-44e9-ba61-1051a74f5ef0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.177869 Aug 08 16:52:44.230429 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 66/137] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:44 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:44.658195 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-3971a52f-0436-460f-b309-97a94fc60620 req-81c87fbe-c68c-47e4-bf69-22b0802fb6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65990fbf-4d36-42ed-8f3b-3406d373841a", "name": "network-vif-plugged", "status": "completed", "tag": "aa00f426-38ee-4d32-8b5a-c76a247b3988"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:44.668595 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-3971a52f-0436-460f-b309-97a94fc60620 req-81c87fbe-c68c-47e4-bf69-22b0802fb6d8 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:44.671329 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-3971a52f-0436-460f-b309-97a94fc60620 req-81c87fbe-c68c-47e4-bf69-22b0802fb6d8 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:44.671329 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-3971a52f-0436-460f-b309-97a94fc60620 req-81c87fbe-c68c-47e4-bf69-22b0802fb6d8 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:44.678040 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-bd2c8f0e-5cd4-44f4-884d-fdfe40b80cfe tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:44.678715 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-bd2c8f0e-5cd4-44f4-884d-fdfe40b80cfe tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:44.683682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-3971a52f-0436-460f-b309-97a94fc60620 req-81c87fbe-c68c-47e4-bf69-22b0802fb6d8 service nova] Creating event network-vif-plugged:aa00f426-38ee-4d32-8b5a-c76a247b3988 for instance 65990fbf-4d36-42ed-8f3b-3406d373841a on hv-cinder-85220 Aug 08 16:52:44.686917 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bd2c8f0e-5cd4-44f4-884d-fdfe40b80cfe tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:44.687608 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bd2c8f0e-5cd4-44f4-884d-fdfe40b80cfe tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:44.688253 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bd2c8f0e-5cd4-44f4-884d-fdfe40b80cfe tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:44.689548 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bd2c8f0e-5cd4-44f4-884d-fdfe40b80cfe tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:44.690103 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bd2c8f0e-5cd4-44f4-884d-fdfe40b80cfe tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:44.690734 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-3971a52f-0436-460f-b309-97a94fc60620 req-81c87fbe-c68c-47e4-bf69-22b0802fb6d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036268 Aug 08 16:52:44.690905 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bd2c8f0e-5cd4-44f4-884d-fdfe40b80cfe tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:44.691886 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 72/138] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:44.869734 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bd2c8f0e-5cd4-44f4-884d-fdfe40b80cfe tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:44.878440 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-bd2c8f0e-5cd4-44f4-884d-fdfe40b80cfe tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.204638 Aug 08 16:52:44.879127 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 67/139] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:44 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:44.936751 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4154fcb3-08b0-46ba-928c-d09c189692de tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:44.937574 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4154fcb3-08b0-46ba-928c-d09c189692de tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:44.945008 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4154fcb3-08b0-46ba-928c-d09c189692de tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:44.946239 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4154fcb3-08b0-46ba-928c-d09c189692de tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:44.946724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4154fcb3-08b0-46ba-928c-d09c189692de tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:44.947978 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4154fcb3-08b0-46ba-928c-d09c189692de tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:44.948330 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4154fcb3-08b0-46ba-928c-d09c189692de tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:44.948631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4154fcb3-08b0-46ba-928c-d09c189692de tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:45.111942 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0ebcfb26-8563-45db-8637-fbdd3b823173 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:45.116952 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0ebcfb26-8563-45db-8637-fbdd3b823173 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:45.144714 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ebcfb26-8563-45db-8637-fbdd3b823173 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:45.145652 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ebcfb26-8563-45db-8637-fbdd3b823173 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:45.146555 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ebcfb26-8563-45db-8637-fbdd3b823173 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:45.149458 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ebcfb26-8563-45db-8637-fbdd3b823173 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:45.150836 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ebcfb26-8563-45db-8637-fbdd3b823173 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:45.151951 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ebcfb26-8563-45db-8637-fbdd3b823173 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:45.165330 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4154fcb3-08b0-46ba-928c-d09c189692de tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:45.181013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4154fcb3-08b0-46ba-928c-d09c189692de tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.252454 Aug 08 16:52:45.194286 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 73/140] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:44 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:45.254598 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6e5be571-679b-4263-ae95-b6288ef9adb2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:45.255556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6e5be571-679b-4263-ae95-b6288ef9adb2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:45.267489 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e5be571-679b-4263-ae95-b6288ef9adb2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:45.269046 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e5be571-679b-4263-ae95-b6288ef9adb2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:45.270152 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e5be571-679b-4263-ae95-b6288ef9adb2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:45.271822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e5be571-679b-4263-ae95-b6288ef9adb2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:45.274853 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e5be571-679b-4263-ae95-b6288ef9adb2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:45.276748 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e5be571-679b-4263-ae95-b6288ef9adb2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:45.464148 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0ebcfb26-8563-45db-8637-fbdd3b823173 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:45.480850 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0ebcfb26-8563-45db-8637-fbdd3b823173 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.378274 Aug 08 16:52:45.482630 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 68/141] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:45 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:45.623714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-6e5be571-679b-4263-ae95-b6288ef9adb2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:45.636892 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-6e5be571-679b-4263-ae95-b6288ef9adb2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.387717 Aug 08 16:52:45.649302 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 74/142] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:45 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:45.907229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2c122aee-9f74-40eb-acfd-fe46b23e3b6e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:45.908295 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2c122aee-9f74-40eb-acfd-fe46b23e3b6e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:45.921083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2c122aee-9f74-40eb-acfd-fe46b23e3b6e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:45.921944 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2c122aee-9f74-40eb-acfd-fe46b23e3b6e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:45.922694 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2c122aee-9f74-40eb-acfd-fe46b23e3b6e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:45.923936 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2c122aee-9f74-40eb-acfd-fe46b23e3b6e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:45.924704 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2c122aee-9f74-40eb-acfd-fe46b23e3b6e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:45.925446 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2c122aee-9f74-40eb-acfd-fe46b23e3b6e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:46.192630 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2c122aee-9f74-40eb-acfd-fe46b23e3b6e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:46.219423 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2c122aee-9f74-40eb-acfd-fe46b23e3b6e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.321663 Aug 08 16:52:46.222044 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f43ff8c6-7700-4157-8a50-78cc75c7a5f0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:46.223194 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f43ff8c6-7700-4157-8a50-78cc75c7a5f0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:46.235406 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 69/143] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:45 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:46.236173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f43ff8c6-7700-4157-8a50-78cc75c7a5f0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:46.237052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f43ff8c6-7700-4157-8a50-78cc75c7a5f0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:46.237835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f43ff8c6-7700-4157-8a50-78cc75c7a5f0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:46.239644 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f43ff8c6-7700-4157-8a50-78cc75c7a5f0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:46.240576 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f43ff8c6-7700-4157-8a50-78cc75c7a5f0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:46.242039 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f43ff8c6-7700-4157-8a50-78cc75c7a5f0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:46.504310 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d7724c96-89d2-4a45-94c2-eae8e0f5017b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:46.505016 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d7724c96-89d2-4a45-94c2-eae8e0f5017b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:46.518290 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7724c96-89d2-4a45-94c2-eae8e0f5017b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:46.519234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7724c96-89d2-4a45-94c2-eae8e0f5017b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:46.520152 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7724c96-89d2-4a45-94c2-eae8e0f5017b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:46.521044 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7724c96-89d2-4a45-94c2-eae8e0f5017b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:46.521767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7724c96-89d2-4a45-94c2-eae8e0f5017b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:46.522392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7724c96-89d2-4a45-94c2-eae8e0f5017b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:46.621788 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f43ff8c6-7700-4157-8a50-78cc75c7a5f0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:46.640775 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f43ff8c6-7700-4157-8a50-78cc75c7a5f0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.428180 Aug 08 16:52:46.641828 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 75/144] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:46 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:46.679149 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c659e160-1361-4223-9cd2-257a6aece0a6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:46.679864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c659e160-1361-4223-9cd2-257a6aece0a6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:46.687351 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c659e160-1361-4223-9cd2-257a6aece0a6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:46.687849 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c659e160-1361-4223-9cd2-257a6aece0a6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:46.688326 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c659e160-1361-4223-9cd2-257a6aece0a6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:46.688999 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c659e160-1361-4223-9cd2-257a6aece0a6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:46.689750 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c659e160-1361-4223-9cd2-257a6aece0a6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:46.690173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c659e160-1361-4223-9cd2-257a6aece0a6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:46.765294 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d7724c96-89d2-4a45-94c2-eae8e0f5017b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:46.780942 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d7724c96-89d2-4a45-94c2-eae8e0f5017b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.279783 Aug 08 16:52:46.782341 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 70/145] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:46 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:46.793476 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-99e3f4e7-ff39-49f9-a2c0-aa10f7beb7ba req-8d4d8544-e517-408d-8bc9-722984e3c602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f523b07-1c20-4eab-a270-2e16b2895c14", "name": "network-vif-plugged", "status": "completed", "tag": "5f8c4a44-04d1-4ab7-bf9b-3e4a84483e8e"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:46.819249 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-99e3f4e7-ff39-49f9-a2c0-aa10f7beb7ba req-8d4d8544-e517-408d-8bc9-722984e3c602 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:46.821322 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-99e3f4e7-ff39-49f9-a2c0-aa10f7beb7ba req-8d4d8544-e517-408d-8bc9-722984e3c602 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:46.822020 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-99e3f4e7-ff39-49f9-a2c0-aa10f7beb7ba req-8d4d8544-e517-408d-8bc9-722984e3c602 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:46.852128 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-99e3f4e7-ff39-49f9-a2c0-aa10f7beb7ba req-8d4d8544-e517-408d-8bc9-722984e3c602 service nova] Creating event network-vif-plugged:5f8c4a44-04d1-4ab7-bf9b-3e4a84483e8e for instance 9f523b07-1c20-4eab-a270-2e16b2895c14 on hv-cinder-85220 Aug 08 16:52:46.861418 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-99e3f4e7-ff39-49f9-a2c0-aa10f7beb7ba req-8d4d8544-e517-408d-8bc9-722984e3c602 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075054 Aug 08 16:52:46.862928 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 71/146] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:46.930151 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c659e160-1361-4223-9cd2-257a6aece0a6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:46.943402 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c659e160-1361-4223-9cd2-257a6aece0a6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.282774 Aug 08 16:52:46.951706 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 76/147] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:46 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:47.254828 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8fa3994c-c451-4aba-8635-25a55000437c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:47.262703 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8fa3994c-c451-4aba-8635-25a55000437c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:47.295419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8fa3994c-c451-4aba-8635-25a55000437c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:47.296308 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8fa3994c-c451-4aba-8635-25a55000437c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:47.297298 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8fa3994c-c451-4aba-8635-25a55000437c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:47.298940 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8fa3994c-c451-4aba-8635-25a55000437c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:47.300001 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8fa3994c-c451-4aba-8635-25a55000437c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:47.300984 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8fa3994c-c451-4aba-8635-25a55000437c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:47.591954 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8fa3994c-c451-4aba-8635-25a55000437c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:47.600332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-8fa3994c-c451-4aba-8635-25a55000437c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.355652 Aug 08 16:52:47.602613 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 72/148] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:47 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:47.689578 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b3e59717-8bff-44ae-b841-b7d982f2f61b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:47.702532 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b3e59717-8bff-44ae-b841-b7d982f2f61b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:47.733110 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b3e59717-8bff-44ae-b841-b7d982f2f61b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:47.735555 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b3e59717-8bff-44ae-b841-b7d982f2f61b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:47.738542 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b3e59717-8bff-44ae-b841-b7d982f2f61b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:47.743792 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b3e59717-8bff-44ae-b841-b7d982f2f61b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:47.747911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b3e59717-8bff-44ae-b841-b7d982f2f61b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:47.752679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b3e59717-8bff-44ae-b841-b7d982f2f61b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:47.825523 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-300b1a28-3ae0-498e-a4cd-98b6fc61e0db tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:47.830227 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-300b1a28-3ae0-498e-a4cd-98b6fc61e0db tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:47.898014 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-300b1a28-3ae0-498e-a4cd-98b6fc61e0db tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:47.903169 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-300b1a28-3ae0-498e-a4cd-98b6fc61e0db tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:47.903954 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-300b1a28-3ae0-498e-a4cd-98b6fc61e0db tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:47.908759 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-300b1a28-3ae0-498e-a4cd-98b6fc61e0db tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:47.913892 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-300b1a28-3ae0-498e-a4cd-98b6fc61e0db tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:47.924189 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-300b1a28-3ae0-498e-a4cd-98b6fc61e0db tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:48.131823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b3e59717-8bff-44ae-b841-b7d982f2f61b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:48.146460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b3e59717-8bff-44ae-b841-b7d982f2f61b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.485012 Aug 08 16:52:48.158673 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 77/149] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:47 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:48.167978 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fd199471-776f-4991-8dbd-fd597336bf4c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:48.170614 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fd199471-776f-4991-8dbd-fd597336bf4c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:48.192582 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd199471-776f-4991-8dbd-fd597336bf4c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:48.193913 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd199471-776f-4991-8dbd-fd597336bf4c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:48.195794 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd199471-776f-4991-8dbd-fd597336bf4c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:48.197157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd199471-776f-4991-8dbd-fd597336bf4c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:48.198079 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd199471-776f-4991-8dbd-fd597336bf4c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:48.199036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd199471-776f-4991-8dbd-fd597336bf4c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:48.370112 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-300b1a28-3ae0-498e-a4cd-98b6fc61e0db tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:48.380580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-300b1a28-3ae0-498e-a4cd-98b6fc61e0db tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.566061 Aug 08 16:52:48.381631 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 73/150] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:47 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:48.416026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fd199471-776f-4991-8dbd-fd597336bf4c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:48.424198 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fd199471-776f-4991-8dbd-fd597336bf4c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.272412 Aug 08 16:52:48.425013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 78/151] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:48 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:48.635095 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2d45659b-2038-4c77-8a73-0d85448d8dd6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:48.635776 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2d45659b-2038-4c77-8a73-0d85448d8dd6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:48.642267 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d45659b-2038-4c77-8a73-0d85448d8dd6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:48.642768 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d45659b-2038-4c77-8a73-0d85448d8dd6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:48.643204 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d45659b-2038-4c77-8a73-0d85448d8dd6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:48.643917 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d45659b-2038-4c77-8a73-0d85448d8dd6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:48.644368 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d45659b-2038-4c77-8a73-0d85448d8dd6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:48.644790 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d45659b-2038-4c77-8a73-0d85448d8dd6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:48.650284 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=100 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:48.828756 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2d45659b-2038-4c77-8a73-0d85448d8dd6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:48.841892 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2d45659b-2038-4c77-8a73-0d85448d8dd6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.212167 Aug 08 16:52:48.843123 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 74/152] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:48 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:48.880144 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-883466b4-4d45-4ad1-8ab4-6a5c31fba860 req-747271f0-f422-4a3e-b9ad-ea0fe8778b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0affcec-8e4c-461a-ac29-5ac8d4fd92bd", "name": "network-vif-plugged", "status": "completed", "tag": "412ef6d6-1ffe-43de-9f26-f0beb2a5afac"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:48.892554 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-883466b4-4d45-4ad1-8ab4-6a5c31fba860 req-747271f0-f422-4a3e-b9ad-ea0fe8778b40 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:48.893168 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-883466b4-4d45-4ad1-8ab4-6a5c31fba860 req-747271f0-f422-4a3e-b9ad-ea0fe8778b40 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:48.893819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-883466b4-4d45-4ad1-8ab4-6a5c31fba860 req-747271f0-f422-4a3e-b9ad-ea0fe8778b40 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:48.908786 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-883466b4-4d45-4ad1-8ab4-6a5c31fba860 req-747271f0-f422-4a3e-b9ad-ea0fe8778b40 service nova] Creating event network-vif-plugged:412ef6d6-1ffe-43de-9f26-f0beb2a5afac for instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd on hv-cinder-85220 Aug 08 16:52:48.917146 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-883466b4-4d45-4ad1-8ab4-6a5c31fba860 req-747271f0-f422-4a3e-b9ad-ea0fe8778b40 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041166 Aug 08 16:52:48.917915 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 79/153] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:49.174282 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e85c72f8-8a93-4c09-b61f-8a8c3b41ab41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:49.175516 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e85c72f8-8a93-4c09-b61f-8a8c3b41ab41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:49.188358 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e85c72f8-8a93-4c09-b61f-8a8c3b41ab41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:49.189435 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e85c72f8-8a93-4c09-b61f-8a8c3b41ab41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:49.190211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e85c72f8-8a93-4c09-b61f-8a8c3b41ab41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:49.191506 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e85c72f8-8a93-4c09-b61f-8a8c3b41ab41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:49.192288 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e85c72f8-8a93-4c09-b61f-8a8c3b41ab41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:49.193018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e85c72f8-8a93-4c09-b61f-8a8c3b41ab41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:49.393072 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e85c72f8-8a93-4c09-b61f-8a8c3b41ab41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:49.402843 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e85c72f8-8a93-4c09-b61f-8a8c3b41ab41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.236396 Aug 08 16:52:49.405502 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 75/154] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:49 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:49.418767 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d4f4e3c7-cee0-4e79-8eee-2cc347a35708 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:49.418767 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d4f4e3c7-cee0-4e79-8eee-2cc347a35708 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:49.422733 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4f4e3c7-cee0-4e79-8eee-2cc347a35708 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:49.423566 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4f4e3c7-cee0-4e79-8eee-2cc347a35708 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:49.424353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4f4e3c7-cee0-4e79-8eee-2cc347a35708 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:49.425866 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4f4e3c7-cee0-4e79-8eee-2cc347a35708 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:49.426767 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4f4e3c7-cee0-4e79-8eee-2cc347a35708 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:49.427503 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4f4e3c7-cee0-4e79-8eee-2cc347a35708 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:49.451559 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-297e9f84-b4c7-4853-83ea-2311f9c921cc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:49.452794 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-297e9f84-b4c7-4853-83ea-2311f9c921cc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:49.459786 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-297e9f84-b4c7-4853-83ea-2311f9c921cc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:49.461735 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-297e9f84-b4c7-4853-83ea-2311f9c921cc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:49.462362 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-297e9f84-b4c7-4853-83ea-2311f9c921cc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:49.463406 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-297e9f84-b4c7-4853-83ea-2311f9c921cc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:49.463974 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-297e9f84-b4c7-4853-83ea-2311f9c921cc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:49.464503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-297e9f84-b4c7-4853-83ea-2311f9c921cc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:49.678279 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-297e9f84-b4c7-4853-83ea-2311f9c921cc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:49.692871 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-297e9f84-b4c7-4853-83ea-2311f9c921cc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.244773 Aug 08 16:52:49.693891 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 76/155] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:49 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:49.727765 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d4f4e3c7-cee0-4e79-8eee-2cc347a35708 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:49.738528 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d4f4e3c7-cee0-4e79-8eee-2cc347a35708 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.337651 Aug 08 16:52:49.739296 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 80/156] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:49 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:49.882045 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d20ae8b5-44bb-419a-b9e2-b4be0f91a0ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:49.883264 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d20ae8b5-44bb-419a-b9e2-b4be0f91a0ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:49.894221 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d20ae8b5-44bb-419a-b9e2-b4be0f91a0ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:49.895130 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d20ae8b5-44bb-419a-b9e2-b4be0f91a0ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:49.895931 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d20ae8b5-44bb-419a-b9e2-b4be0f91a0ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:49.897208 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d20ae8b5-44bb-419a-b9e2-b4be0f91a0ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:49.898597 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d20ae8b5-44bb-419a-b9e2-b4be0f91a0ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:49.899392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d20ae8b5-44bb-419a-b9e2-b4be0f91a0ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:50.150893 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d20ae8b5-44bb-419a-b9e2-b4be0f91a0ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:50.164348 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d20ae8b5-44bb-419a-b9e2-b4be0f91a0ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.289250 Aug 08 16:52:50.165258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 77/157] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:49 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:50.431159 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7014fabb-1cf1-48fa-beae-9417ae356a8e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:50.432235 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7014fabb-1cf1-48fa-beae-9417ae356a8e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:50.442924 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7014fabb-1cf1-48fa-beae-9417ae356a8e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:50.443780 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7014fabb-1cf1-48fa-beae-9417ae356a8e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:50.445182 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7014fabb-1cf1-48fa-beae-9417ae356a8e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:50.446738 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7014fabb-1cf1-48fa-beae-9417ae356a8e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:50.447542 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7014fabb-1cf1-48fa-beae-9417ae356a8e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:50.448198 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7014fabb-1cf1-48fa-beae-9417ae356a8e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:50.656439 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7014fabb-1cf1-48fa-beae-9417ae356a8e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:50.665011 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7014fabb-1cf1-48fa-beae-9417ae356a8e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.241384 Aug 08 16:52:50.665623 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 81/158] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:50 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:50.725571 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4be7cb33-dbf4-40ee-901a-531a480aac64 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:50.726848 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4be7cb33-dbf4-40ee-901a-531a480aac64 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:50.734223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4be7cb33-dbf4-40ee-901a-531a480aac64 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:50.734763 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4be7cb33-dbf4-40ee-901a-531a480aac64 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:50.735206 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4be7cb33-dbf4-40ee-901a-531a480aac64 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:50.735930 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4be7cb33-dbf4-40ee-901a-531a480aac64 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:50.736423 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4be7cb33-dbf4-40ee-901a-531a480aac64 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:50.736855 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4be7cb33-dbf4-40ee-901a-531a480aac64 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:50.769734 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-cffdec84-8d3c-46e5-a2b8-5185c3623db3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:50.771231 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-cffdec84-8d3c-46e5-a2b8-5185c3623db3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:50.781894 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cffdec84-8d3c-46e5-a2b8-5185c3623db3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:50.782921 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cffdec84-8d3c-46e5-a2b8-5185c3623db3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:50.783368 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cffdec84-8d3c-46e5-a2b8-5185c3623db3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:50.784084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cffdec84-8d3c-46e5-a2b8-5185c3623db3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:50.784769 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cffdec84-8d3c-46e5-a2b8-5185c3623db3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:50.785167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cffdec84-8d3c-46e5-a2b8-5185c3623db3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:50.790910 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=100 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:51.034459 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4be7cb33-dbf4-40ee-901a-531a480aac64 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:51.048338 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4be7cb33-dbf4-40ee-901a-531a480aac64 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.327127 Aug 08 16:52:51.049060 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 78/159] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:50 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:51.050222 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-cffdec84-8d3c-46e5-a2b8-5185c3623db3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:51.065229 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-cffdec84-8d3c-46e5-a2b8-5185c3623db3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1315 microversion: 2.1 time: 0.301039 Aug 08 16:52:51.066312 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 82/160] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:50 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:51.198867 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5bf309f1-fe3f-42dc-ac96-43f3463640e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:51.199405 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5bf309f1-fe3f-42dc-ac96-43f3463640e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:51.206479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bf309f1-fe3f-42dc-ac96-43f3463640e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:51.206997 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bf309f1-fe3f-42dc-ac96-43f3463640e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:51.207432 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bf309f1-fe3f-42dc-ac96-43f3463640e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:51.208158 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bf309f1-fe3f-42dc-ac96-43f3463640e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:51.208616 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bf309f1-fe3f-42dc-ac96-43f3463640e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:51.209042 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bf309f1-fe3f-42dc-ac96-43f3463640e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:51.414513 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-5bf309f1-fe3f-42dc-ac96-43f3463640e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:51.428517 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5bf309f1-fe3f-42dc-ac96-43f3463640e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.234205 Aug 08 16:52:51.430888 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 79/161] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:51 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:51.686266 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4404abae-7e49-4937-800f-300811ecc241 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:51.687193 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4404abae-7e49-4937-800f-300811ecc241 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:51.693508 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4404abae-7e49-4937-800f-300811ecc241 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:51.694096 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4404abae-7e49-4937-800f-300811ecc241 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:51.695173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4404abae-7e49-4937-800f-300811ecc241 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:51.695905 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4404abae-7e49-4937-800f-300811ecc241 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:51.696370 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4404abae-7e49-4937-800f-300811ecc241 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:51.696834 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4404abae-7e49-4937-800f-300811ecc241 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:51.911210 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4404abae-7e49-4937-800f-300811ecc241 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:51.929333 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4404abae-7e49-4937-800f-300811ecc241 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.241097 Aug 08 16:52:51.929333 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 83/162] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:51 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:52.087640 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8caecaad-48f7-4e82-9496-68a40b84dbd6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:52.088785 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8caecaad-48f7-4e82-9496-68a40b84dbd6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:52.098346 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-14a82fe8-748e-4209-889d-76bb8ac3f3f3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:52.099452 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-14a82fe8-748e-4209-889d-76bb8ac3f3f3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:52.103530 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8caecaad-48f7-4e82-9496-68a40b84dbd6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:52.104419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8caecaad-48f7-4e82-9496-68a40b84dbd6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:52.105414 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8caecaad-48f7-4e82-9496-68a40b84dbd6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:52.107047 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8caecaad-48f7-4e82-9496-68a40b84dbd6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:52.108129 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8caecaad-48f7-4e82-9496-68a40b84dbd6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:52.108450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-14a82fe8-748e-4209-889d-76bb8ac3f3f3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:52.109104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-14a82fe8-748e-4209-889d-76bb8ac3f3f3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:52.109538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8caecaad-48f7-4e82-9496-68a40b84dbd6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:52.109705 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-14a82fe8-748e-4209-889d-76bb8ac3f3f3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:52.110653 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-14a82fe8-748e-4209-889d-76bb8ac3f3f3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:52.111485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-14a82fe8-748e-4209-889d-76bb8ac3f3f3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:52.117615 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-14a82fe8-748e-4209-889d-76bb8ac3f3f3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:52.344745 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-14a82fe8-748e-4209-889d-76bb8ac3f3f3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:52.360597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-14a82fe8-748e-4209-889d-76bb8ac3f3f3 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1503 microversion: 2.1 time: 0.266753 Aug 08 16:52:52.374815 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 84/163] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:52 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:52.376121 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8caecaad-48f7-4e82-9496-68a40b84dbd6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:52.391653 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-8caecaad-48f7-4e82-9496-68a40b84dbd6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.311863 Aug 08 16:52:52.393134 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 80/164] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:52 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:52.458211 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1291d145-6449-416b-bdb5-e0e310d23540 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:52.458876 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1291d145-6449-416b-bdb5-e0e310d23540 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:52.466756 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1291d145-6449-416b-bdb5-e0e310d23540 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:52.470929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1291d145-6449-416b-bdb5-e0e310d23540 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:52.470929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1291d145-6449-416b-bdb5-e0e310d23540 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:52.470929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1291d145-6449-416b-bdb5-e0e310d23540 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:52.470929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1291d145-6449-416b-bdb5-e0e310d23540 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:52.471443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1291d145-6449-416b-bdb5-e0e310d23540 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:52.716869 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1291d145-6449-416b-bdb5-e0e310d23540 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:52.726529 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1291d145-6449-416b-bdb5-e0e310d23540 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.274375 Aug 08 16:52:52.727065 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 85/165] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:52 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:52.971249 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-39b50388-28e3-4229-9cd1-3f9b34992e11 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:52.971249 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-39b50388-28e3-4229-9cd1-3f9b34992e11 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:52.978111 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-39b50388-28e3-4229-9cd1-3f9b34992e11 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:52.979341 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-39b50388-28e3-4229-9cd1-3f9b34992e11 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:52.980085 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-39b50388-28e3-4229-9cd1-3f9b34992e11 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:52.981290 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-39b50388-28e3-4229-9cd1-3f9b34992e11 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:52.982718 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-39b50388-28e3-4229-9cd1-3f9b34992e11 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:52.983455 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-39b50388-28e3-4229-9cd1-3f9b34992e11 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:53.169170 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-39b50388-28e3-4229-9cd1-3f9b34992e11 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:53.187103 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-39b50388-28e3-4229-9cd1-3f9b34992e11 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.230051 Aug 08 16:52:53.189439 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 81/166] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:52 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:53.422768 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4743f4ea-b3ba-4c5e-9a87-2b60ddaf3bd7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:53.423963 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4743f4ea-b3ba-4c5e-9a87-2b60ddaf3bd7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:53.431309 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4743f4ea-b3ba-4c5e-9a87-2b60ddaf3bd7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:53.436913 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4743f4ea-b3ba-4c5e-9a87-2b60ddaf3bd7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:53.436913 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4743f4ea-b3ba-4c5e-9a87-2b60ddaf3bd7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:53.436913 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4743f4ea-b3ba-4c5e-9a87-2b60ddaf3bd7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:53.436913 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4743f4ea-b3ba-4c5e-9a87-2b60ddaf3bd7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:53.437526 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4743f4ea-b3ba-4c5e-9a87-2b60ddaf3bd7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:53.589803 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4743f4ea-b3ba-4c5e-9a87-2b60ddaf3bd7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:53.599201 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4743f4ea-b3ba-4c5e-9a87-2b60ddaf3bd7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.186100 Aug 08 16:52:53.600153 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 86/167] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:53 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:53.750988 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-712fd67c-7f31-4226-a62b-a07fd829be6d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:53.752049 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-712fd67c-7f31-4226-a62b-a07fd829be6d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:53.755375 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=97 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:53.773306 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-712fd67c-7f31-4226-a62b-a07fd829be6d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:53.773306 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-712fd67c-7f31-4226-a62b-a07fd829be6d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:53.773306 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-712fd67c-7f31-4226-a62b-a07fd829be6d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:53.773306 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-712fd67c-7f31-4226-a62b-a07fd829be6d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:53.774071 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-712fd67c-7f31-4226-a62b-a07fd829be6d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:53.774071 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-712fd67c-7f31-4226-a62b-a07fd829be6d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:54.030534 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-712fd67c-7f31-4226-a62b-a07fd829be6d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:54.039958 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-712fd67c-7f31-4226-a62b-a07fd829be6d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.294293 Aug 08 16:52:54.041017 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 82/168] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:53 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:54.236562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7ff7b5a6-3354-4066-a966-98b3ec4c2412 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:54.237783 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7ff7b5a6-3354-4066-a966-98b3ec4c2412 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:54.247816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7ff7b5a6-3354-4066-a966-98b3ec4c2412 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:54.248498 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7ff7b5a6-3354-4066-a966-98b3ec4c2412 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:54.249002 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7ff7b5a6-3354-4066-a966-98b3ec4c2412 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:54.249820 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7ff7b5a6-3354-4066-a966-98b3ec4c2412 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:54.250637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7ff7b5a6-3354-4066-a966-98b3ec4c2412 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:54.251214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7ff7b5a6-3354-4066-a966-98b3ec4c2412 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:54.529742 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7ff7b5a6-3354-4066-a966-98b3ec4c2412 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:54.543995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7ff7b5a6-3354-4066-a966-98b3ec4c2412 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.314548 Aug 08 16:52:54.545084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 87/169] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:54 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:54.639850 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e6f313ac-f553-4699-943d-1c60099d889c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:54.641020 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e6f313ac-f553-4699-943d-1c60099d889c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:54.649762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e6f313ac-f553-4699-943d-1c60099d889c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:54.650265 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e6f313ac-f553-4699-943d-1c60099d889c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:54.650796 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e6f313ac-f553-4699-943d-1c60099d889c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:54.651525 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e6f313ac-f553-4699-943d-1c60099d889c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:54.652014 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e6f313ac-f553-4699-943d-1c60099d889c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:54.656165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e6f313ac-f553-4699-943d-1c60099d889c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:54.845937 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e6f313ac-f553-4699-943d-1c60099d889c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:54.861026 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e6f313ac-f553-4699-943d-1c60099d889c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1322 microversion: 2.1 time: 0.229549 Aug 08 16:52:54.862248 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 83/170] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:54 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:54.916267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-e7d60eb6-4de9-4840-b5eb-8f9639c50c54 req-dfb410ae-af03-403d-b2c8-1bada96c2e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba167d3-4013-4e79-8c84-5a72b458b6f7", "name": "network-vif-plugged", "status": "completed", "tag": "adc434bf-69d7-4da9-9eea-f961d0824299"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:54.935399 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e7d60eb6-4de9-4840-b5eb-8f9639c50c54 req-dfb410ae-af03-403d-b2c8-1bada96c2e1d service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:54.936204 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e7d60eb6-4de9-4840-b5eb-8f9639c50c54 req-dfb410ae-af03-403d-b2c8-1bada96c2e1d service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:54.936951 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e7d60eb6-4de9-4840-b5eb-8f9639c50c54 req-dfb410ae-af03-403d-b2c8-1bada96c2e1d service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:54.954450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-e7d60eb6-4de9-4840-b5eb-8f9639c50c54 req-dfb410ae-af03-403d-b2c8-1bada96c2e1d service nova] Creating event network-vif-plugged:adc434bf-69d7-4da9-9eea-f961d0824299 for instance cba167d3-4013-4e79-8c84-5a72b458b6f7 on hv-cinder-85220 Aug 08 16:52:54.960329 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-e7d60eb6-4de9-4840-b5eb-8f9639c50c54 req-dfb410ae-af03-403d-b2c8-1bada96c2e1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049781 Aug 08 16:52:54.960930 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 88/171] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:52:55.080696 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-655701b0-c11d-4e71-823c-ae05da1286c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:55.081828 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-655701b0-c11d-4e71-823c-ae05da1286c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:55.095153 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-655701b0-c11d-4e71-823c-ae05da1286c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:55.095921 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-655701b0-c11d-4e71-823c-ae05da1286c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:55.096703 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-655701b0-c11d-4e71-823c-ae05da1286c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:55.098003 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-655701b0-c11d-4e71-823c-ae05da1286c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:55.098870 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-655701b0-c11d-4e71-823c-ae05da1286c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:55.099633 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-655701b0-c11d-4e71-823c-ae05da1286c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:55.314849 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-655701b0-c11d-4e71-823c-ae05da1286c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:55.330264 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-655701b0-c11d-4e71-823c-ae05da1286c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.256951 Aug 08 16:52:55.332442 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 84/172] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:55 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:55.551916 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-94eba49a-8355-4972-a753-87ff727dfc07 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccd92b89-f9ca-4dba-98f2-ef9a4856cf83"}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:55.557146 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-94eba49a-8355-4972-a753-87ff727dfc07 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:55.572393 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-82dab705-31a8-449d-8d0c-81f962285fa9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:55.573556 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-82dab705-31a8-449d-8d0c-81f962285fa9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:55.583097 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-94eba49a-8355-4972-a753-87ff727dfc07 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:55.583679 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-82dab705-31a8-449d-8d0c-81f962285fa9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:55.584497 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-82dab705-31a8-449d-8d0c-81f962285fa9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:55.585991 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-82dab705-31a8-449d-8d0c-81f962285fa9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:55.587185 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-94eba49a-8355-4972-a753-87ff727dfc07 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:55.587551 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-82dab705-31a8-449d-8d0c-81f962285fa9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:55.588141 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-94eba49a-8355-4972-a753-87ff727dfc07 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:55.588744 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-82dab705-31a8-449d-8d0c-81f962285fa9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:55.589499 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-94eba49a-8355-4972-a753-87ff727dfc07 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:55.589849 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-82dab705-31a8-449d-8d0c-81f962285fa9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:55.590438 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-94eba49a-8355-4972-a753-87ff727dfc07 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:55.591240 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-94eba49a-8355-4972-a753-87ff727dfc07 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:55.840317 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-82dab705-31a8-449d-8d0c-81f962285fa9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:55.855633 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-82dab705-31a8-449d-8d0c-81f962285fa9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.291134 Aug 08 16:52:55.857407 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 85/173] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:55 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:55.898421 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6aa2d432-0769-44b3-bc4c-a43f255b8586 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:55.899340 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6aa2d432-0769-44b3-bc4c-a43f255b8586 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:55.905782 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6aa2d432-0769-44b3-bc4c-a43f255b8586 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:55.906428 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6aa2d432-0769-44b3-bc4c-a43f255b8586 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:55.906916 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6aa2d432-0769-44b3-bc4c-a43f255b8586 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:55.907639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6aa2d432-0769-44b3-bc4c-a43f255b8586 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:55.908095 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6aa2d432-0769-44b3-bc4c-a43f255b8586 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:55.908515 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6aa2d432-0769-44b3-bc4c-a43f255b8586 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:56.139586 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6aa2d432-0769-44b3-bc4c-a43f255b8586 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:56.152021 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6aa2d432-0769-44b3-bc4c-a43f255b8586 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1516 microversion: 2.1 time: 0.258157 Aug 08 16:52:56.152917 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 86/174] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:55 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1516 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:56.192243 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b3b930a8-85e5-420b-8b96-90ce2bda80e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:52:56.196668 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b3b930a8-85e5-420b-8b96-90ce2bda80e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:56.207169 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b3b930a8-85e5-420b-8b96-90ce2bda80e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:56.207946 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b3b930a8-85e5-420b-8b96-90ce2bda80e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:56.208804 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b3b930a8-85e5-420b-8b96-90ce2bda80e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:56.210126 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b3b930a8-85e5-420b-8b96-90ce2bda80e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:56.210944 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b3b930a8-85e5-420b-8b96-90ce2bda80e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:56.211657 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b3b930a8-85e5-420b-8b96-90ce2bda80e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:56.308492 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-b3b930a8-85e5-420b-8b96-90ce2bda80e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lazy-loading 'flavor' on Instance uuid 9f523b07-1c20-4eab-a270-2e16b2895c14 {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:52:56.739568 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b3b930a8-85e5-420b-8b96-90ce2bda80e4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "POST /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14/action" status: 200 len: 32 microversion: 2.1 time: 0.554239 Aug 08 16:52:56.745779 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 87/175] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 16:52:56 2022] POST /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14/action => generated 32 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 16:52:56.758393 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-38d6ac02-e12d-4b2c-8b94-b49ac4ea4599 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:56.761124 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-38d6ac02-e12d-4b2c-8b94-b49ac4ea4599 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:56.776924 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-38d6ac02-e12d-4b2c-8b94-b49ac4ea4599 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:56.788603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-38d6ac02-e12d-4b2c-8b94-b49ac4ea4599 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:56.788603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-38d6ac02-e12d-4b2c-8b94-b49ac4ea4599 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:56.788603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-38d6ac02-e12d-4b2c-8b94-b49ac4ea4599 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:56.788603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-38d6ac02-e12d-4b2c-8b94-b49ac4ea4599 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:56.789166 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-38d6ac02-e12d-4b2c-8b94-b49ac4ea4599 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:57.055213 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-38d6ac02-e12d-4b2c-8b94-b49ac4ea4599 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:57.062321 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:52:57.065253 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-38d6ac02-e12d-4b2c-8b94-b49ac4ea4599 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.316018 Aug 08 16:52:57.065884 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 88/176] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:56 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:57.071893 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ccc115ac-3508-4c16-a623-1af219a3e2a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:57.072832 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ccc115ac-3508-4c16-a623-1af219a3e2a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:57.080111 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ccc115ac-3508-4c16-a623-1af219a3e2a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:57.080923 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ccc115ac-3508-4c16-a623-1af219a3e2a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:57.081345 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ccc115ac-3508-4c16-a623-1af219a3e2a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:57.082224 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ccc115ac-3508-4c16-a623-1af219a3e2a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:57.082763 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ccc115ac-3508-4c16-a623-1af219a3e2a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:57.083199 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ccc115ac-3508-4c16-a623-1af219a3e2a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:57.387799 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ccc115ac-3508-4c16-a623-1af219a3e2a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:57.396347 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ccc115ac-3508-4c16-a623-1af219a3e2a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.329249 Aug 08 16:52:57.396779 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 89/177] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:57 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:57.402971 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-da9ad853-28ae-49ef-af3c-8db5e3c298ac tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:57.403895 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-da9ad853-28ae-49ef-af3c-8db5e3c298ac tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:57.412976 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-da9ad853-28ae-49ef-af3c-8db5e3c298ac tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:57.413691 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-da9ad853-28ae-49ef-af3c-8db5e3c298ac tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:57.414532 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-da9ad853-28ae-49ef-af3c-8db5e3c298ac tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:57.415843 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-da9ad853-28ae-49ef-af3c-8db5e3c298ac tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:57.416485 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-da9ad853-28ae-49ef-af3c-8db5e3c298ac tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:57.417123 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-da9ad853-28ae-49ef-af3c-8db5e3c298ac tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:57.594335 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-da9ad853-28ae-49ef-af3c-8db5e3c298ac tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:57.607450 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-da9ad853-28ae-49ef-af3c-8db5e3c298ac tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.208405 Aug 08 16:52:57.608487 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 90/178] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:57 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:58.092606 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-01e003e2-e2a5-4ac6-8597-70f91f8395d5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:58.093292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-01e003e2-e2a5-4ac6-8597-70f91f8395d5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:58.103451 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01e003e2-e2a5-4ac6-8597-70f91f8395d5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:58.104742 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01e003e2-e2a5-4ac6-8597-70f91f8395d5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:58.105498 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01e003e2-e2a5-4ac6-8597-70f91f8395d5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:58.106779 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01e003e2-e2a5-4ac6-8597-70f91f8395d5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:58.107494 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01e003e2-e2a5-4ac6-8597-70f91f8395d5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:58.108061 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01e003e2-e2a5-4ac6-8597-70f91f8395d5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:58.272591 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-01e003e2-e2a5-4ac6-8597-70f91f8395d5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:58.281264 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-01e003e2-e2a5-4ac6-8597-70f91f8395d5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.192607 Aug 08 16:52:58.295483 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 91/179] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:58 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:58.433709 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b4f62097-e871-44c8-8ae5-e75e9106c6b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:58.434393 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b4f62097-e871-44c8-8ae5-e75e9106c6b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:58.440889 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b4f62097-e871-44c8-8ae5-e75e9106c6b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:58.441381 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b4f62097-e871-44c8-8ae5-e75e9106c6b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:58.441844 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b4f62097-e871-44c8-8ae5-e75e9106c6b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:58.442541 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b4f62097-e871-44c8-8ae5-e75e9106c6b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:58.443020 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b4f62097-e871-44c8-8ae5-e75e9106c6b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:58.443440 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b4f62097-e871-44c8-8ae5-e75e9106c6b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:58.621451 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b4f62097-e871-44c8-8ae5-e75e9106c6b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:58.629855 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b4f62097-e871-44c8-8ae5-e75e9106c6b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.201097 Aug 08 16:52:58.630444 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 92/180] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:58 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:58.636233 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-73117a2d-ea37-484d-8146-08014eb93694 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:58.636846 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-73117a2d-ea37-484d-8146-08014eb93694 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:58.647157 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73117a2d-ea37-484d-8146-08014eb93694 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:58.647968 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73117a2d-ea37-484d-8146-08014eb93694 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:58.648666 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73117a2d-ea37-484d-8146-08014eb93694 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:58.650018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73117a2d-ea37-484d-8146-08014eb93694 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:58.650842 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73117a2d-ea37-484d-8146-08014eb93694 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:58.651586 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73117a2d-ea37-484d-8146-08014eb93694 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:58.842165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-73117a2d-ea37-484d-8146-08014eb93694 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:58.851470 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-73117a2d-ea37-484d-8146-08014eb93694 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.219120 Aug 08 16:52:58.851470 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 93/181] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:58 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:52:59.308456 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e3f8a56d-dcb8-4067-8355-70b1d43b8962 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:59.309124 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e3f8a56d-dcb8-4067-8355-70b1d43b8962 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:59.315752 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3f8a56d-dcb8-4067-8355-70b1d43b8962 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:59.316240 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3f8a56d-dcb8-4067-8355-70b1d43b8962 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:59.316681 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3f8a56d-dcb8-4067-8355-70b1d43b8962 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:59.317497 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3f8a56d-dcb8-4067-8355-70b1d43b8962 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:59.317949 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3f8a56d-dcb8-4067-8355-70b1d43b8962 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:59.318388 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3f8a56d-dcb8-4067-8355-70b1d43b8962 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:59.518146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e3f8a56d-dcb8-4067-8355-70b1d43b8962 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:59.535689 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e3f8a56d-dcb8-4067-8355-70b1d43b8962 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.231657 Aug 08 16:52:59.545784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 94/182] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:59 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:59.653222 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6683b78e-88f5-4e63-82b2-93f53ac59514 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:59.653845 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6683b78e-88f5-4e63-82b2-93f53ac59514 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:59.660365 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6683b78e-88f5-4e63-82b2-93f53ac59514 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:59.660868 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6683b78e-88f5-4e63-82b2-93f53ac59514 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:59.661317 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6683b78e-88f5-4e63-82b2-93f53ac59514 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:59.662159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6683b78e-88f5-4e63-82b2-93f53ac59514 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:59.662678 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6683b78e-88f5-4e63-82b2-93f53ac59514 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:59.663281 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6683b78e-88f5-4e63-82b2-93f53ac59514 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:59.870067 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6683b78e-88f5-4e63-82b2-93f53ac59514 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:52:59.885172 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6683b78e-88f5-4e63-82b2-93f53ac59514 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.235810 Aug 08 16:52:59.886209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 95/183] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:59 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:52:59.892770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-25726c5d-59a0-45ac-8634-636f8d624ca7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:52:59.893392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-25726c5d-59a0-45ac-8634-636f8d624ca7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:52:59.901087 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-25726c5d-59a0-45ac-8634-636f8d624ca7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:59.901717 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-25726c5d-59a0-45ac-8634-636f8d624ca7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:59.902171 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-25726c5d-59a0-45ac-8634-636f8d624ca7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:52:59.908005 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-25726c5d-59a0-45ac-8634-636f8d624ca7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:52:59.908005 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-25726c5d-59a0-45ac-8634-636f8d624ca7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:52:59.908005 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-25726c5d-59a0-45ac-8634-636f8d624ca7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:00.119823 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-25726c5d-59a0-45ac-8634-636f8d624ca7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:00.136036 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-25726c5d-59a0-45ac-8634-636f8d624ca7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.247202 Aug 08 16:53:00.137127 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 96/184] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:52:59 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:00.560740 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-63f32696-1b21-4532-8302-5aa4b21fd971 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:00.561961 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-63f32696-1b21-4532-8302-5aa4b21fd971 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:00.572662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63f32696-1b21-4532-8302-5aa4b21fd971 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:00.576455 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63f32696-1b21-4532-8302-5aa4b21fd971 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:00.576455 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63f32696-1b21-4532-8302-5aa4b21fd971 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:00.576455 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63f32696-1b21-4532-8302-5aa4b21fd971 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:00.576455 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63f32696-1b21-4532-8302-5aa4b21fd971 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:00.577343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63f32696-1b21-4532-8302-5aa4b21fd971 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:00.755832 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-63f32696-1b21-4532-8302-5aa4b21fd971 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:00.766351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-63f32696-1b21-4532-8302-5aa4b21fd971 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.210562 Aug 08 16:53:00.767035 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 97/185] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:00 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:00.921846 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1764cc92-8575-4fcb-8db0-b4a4093ebbc6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:00.922834 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1764cc92-8575-4fcb-8db0-b4a4093ebbc6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:00.932944 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1764cc92-8575-4fcb-8db0-b4a4093ebbc6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:00.933689 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1764cc92-8575-4fcb-8db0-b4a4093ebbc6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:00.934359 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1764cc92-8575-4fcb-8db0-b4a4093ebbc6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:00.935543 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1764cc92-8575-4fcb-8db0-b4a4093ebbc6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:00.936261 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1764cc92-8575-4fcb-8db0-b4a4093ebbc6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:00.936921 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1764cc92-8575-4fcb-8db0-b4a4093ebbc6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:01.107186 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1764cc92-8575-4fcb-8db0-b4a4093ebbc6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:01.170699 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1764cc92-8575-4fcb-8db0-b4a4093ebbc6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.255623 Aug 08 16:53:01.177136 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 98/186] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:00 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:01.192876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a060c659-ac2b-4888-ab1d-ca1207f8874e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:01.198440 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a060c659-ac2b-4888-ab1d-ca1207f8874e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:01.218535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a060c659-ac2b-4888-ab1d-ca1207f8874e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:01.219754 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a060c659-ac2b-4888-ab1d-ca1207f8874e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:01.220547 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a060c659-ac2b-4888-ab1d-ca1207f8874e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:01.221968 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a060c659-ac2b-4888-ab1d-ca1207f8874e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:01.224024 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a060c659-ac2b-4888-ab1d-ca1207f8874e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:01.224862 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a060c659-ac2b-4888-ab1d-ca1207f8874e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:01.507644 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a060c659-ac2b-4888-ab1d-ca1207f8874e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:01.518971 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a060c659-ac2b-4888-ab1d-ca1207f8874e tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.340219 Aug 08 16:53:01.519827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 99/187] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:01 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:01.796162 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-20936f1d-8539-4961-abd2-9c40e02d9af2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:01.799609 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-20936f1d-8539-4961-abd2-9c40e02d9af2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:01.809309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20936f1d-8539-4961-abd2-9c40e02d9af2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:01.810106 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20936f1d-8539-4961-abd2-9c40e02d9af2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:01.811300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20936f1d-8539-4961-abd2-9c40e02d9af2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:01.812519 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20936f1d-8539-4961-abd2-9c40e02d9af2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:01.813366 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20936f1d-8539-4961-abd2-9c40e02d9af2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:01.814104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20936f1d-8539-4961-abd2-9c40e02d9af2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:02.071626 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-20936f1d-8539-4961-abd2-9c40e02d9af2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:02.082692 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-20936f1d-8539-4961-abd2-9c40e02d9af2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1365 microversion: 2.1 time: 0.293788 Aug 08 16:53:02.083298 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 100/188] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:01 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:02.197794 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-327379424", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "networks": [{"uuid": "f95845c5-c55e-4114-8c1e-fabee2ca7763"}]}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:02.208550 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-94eba49a-8355-4972-a753-87ff727dfc07 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "POST /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.662625 Aug 08 16:53:02.235835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 89/189] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 16:52:55 2022] POST /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb/os-volume_attachments => generated 194 bytes in 6667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:02.235835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0e896126-8cd7-464d-9e86-9a8a02d88901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:02.235835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0e896126-8cd7-464d-9e86-9a8a02d88901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:02.235835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=94 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:02.235835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e896126-8cd7-464d-9e86-9a8a02d88901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:02.236955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e896126-8cd7-464d-9e86-9a8a02d88901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:02.236955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e896126-8cd7-464d-9e86-9a8a02d88901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:02.236955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e896126-8cd7-464d-9e86-9a8a02d88901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:02.236955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e896126-8cd7-464d-9e86-9a8a02d88901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:02.237240 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e896126-8cd7-464d-9e86-9a8a02d88901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:02.333287 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.network.neutron [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] validate_networks() for [('f95845c5-c55e-4114-8c1e-fabee2ca7763', None, None, None, None, None)] {{(pid=130236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:53:02.522532 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0e896126-8cd7-464d-9e86-9a8a02d88901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:02.531138 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0e896126-8cd7-464d-9e86-9a8a02d88901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.317821 Aug 08 16:53:02.531730 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 90/190] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:02 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:02.543102 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-87ca91be-c03c-4dd7-ac1d-275ce51750b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:02.544073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-87ca91be-c03c-4dd7-ac1d-275ce51750b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:02.551366 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-87ca91be-c03c-4dd7-ac1d-275ce51750b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:02.552140 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-87ca91be-c03c-4dd7-ac1d-275ce51750b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:02.552579 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-87ca91be-c03c-4dd7-ac1d-275ce51750b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:02.553436 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-87ca91be-c03c-4dd7-ac1d-275ce51750b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:02.554062 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-87ca91be-c03c-4dd7-ac1d-275ce51750b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:02.554677 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-87ca91be-c03c-4dd7-ac1d-275ce51750b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:02.828927 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-87ca91be-c03c-4dd7-ac1d-275ce51750b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:02.842090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-87ca91be-c03c-4dd7-ac1d-275ce51750b8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.302709 Aug 08 16:53:02.843222 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 91/191] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:02 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:02.932051 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Flavor limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:53:02.932908 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Image limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:53:02.932908 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Flavor pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:53:02.933325 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Image pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:53:02.933740 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:53:02.947398 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:02.951433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:02.951433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:02.951433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:02.951433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:02.952613 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:02.976151 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Getting quotas for project ec57970389084368ac985ecb58645bd1. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:53:02.981536 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Getting quotas for user 00fdea0388e34b1eb5bfff49a3de5b57 and project ec57970389084368ac985ecb58645bd1. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:53:02.998067 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Going to run 1 instances... {{(pid=130236) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:53:03.000832 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:53:03.108940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d92b7793-0a00-41dd-b8f3-e0b8bba386dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:03.110191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d92b7793-0a00-41dd-b8f3-e0b8bba386dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:03.125836 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d92b7793-0a00-41dd-b8f3-e0b8bba386dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:03.126603 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d92b7793-0a00-41dd-b8f3-e0b8bba386dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:03.127227 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d92b7793-0a00-41dd-b8f3-e0b8bba386dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:03.128034 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d92b7793-0a00-41dd-b8f3-e0b8bba386dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:03.129060 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d92b7793-0a00-41dd-b8f3-e0b8bba386dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:03.129629 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d92b7793-0a00-41dd-b8f3-e0b8bba386dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:03.162173 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6578cfed-a3f9-4825-aaff-bf51482bcd5a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.967336 Aug 08 16:53:03.164008 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 101/192] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:53:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 16:53:03.177475 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-23563347-1402-4f44-82ce-2dc6793d3aa8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:03.179025 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-23563347-1402-4f44-82ce-2dc6793d3aa8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:03.281777 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-23563347-1402-4f44-82ce-2dc6793d3aa8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:03.298159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-23563347-1402-4f44-82ce-2dc6793d3aa8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1213 microversion: 2.1 time: 0.125861 Aug 08 16:53:03.312225 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 102/193] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:03 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1213 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:03.416247 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d92b7793-0a00-41dd-b8f3-e0b8bba386dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:03.428779 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d92b7793-0a00-41dd-b8f3-e0b8bba386dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1553 microversion: 2.1 time: 0.325292 Aug 08 16:53:03.430450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 92/194] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:03 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1553 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:03.471760 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c62b64c1-844d-4ab5-8e10-b3fc578e7483 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:03.473534 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c62b64c1-844d-4ab5-8e10-b3fc578e7483 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:03.492179 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c62b64c1-844d-4ab5-8e10-b3fc578e7483 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:03.492179 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c62b64c1-844d-4ab5-8e10-b3fc578e7483 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:03.492179 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c62b64c1-844d-4ab5-8e10-b3fc578e7483 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:03.492179 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c62b64c1-844d-4ab5-8e10-b3fc578e7483 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:03.493192 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c62b64c1-844d-4ab5-8e10-b3fc578e7483 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:03.494276 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c62b64c1-844d-4ab5-8e10-b3fc578e7483 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:03.565088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5512f014-0395-4508-bbf7-db83261b9dda tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:03.572295 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5512f014-0395-4508-bbf7-db83261b9dda tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:03.593921 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5512f014-0395-4508-bbf7-db83261b9dda tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:03.594474 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5512f014-0395-4508-bbf7-db83261b9dda tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:03.595067 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5512f014-0395-4508-bbf7-db83261b9dda tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:03.595760 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5512f014-0395-4508-bbf7-db83261b9dda tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:03.596436 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5512f014-0395-4508-bbf7-db83261b9dda tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:03.597160 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5512f014-0395-4508-bbf7-db83261b9dda tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:03.650149 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c62b64c1-844d-4ab5-8e10-b3fc578e7483 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185834 Aug 08 16:53:03.651377 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 103/195] 10.222.0.13 () {58 vars in 1275 bytes} [Mon Aug 8 16:53:03 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:03.872977 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fb01a9ba-d763-4aa7-821b-f2e91bec1469 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:03.877129 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fb01a9ba-d763-4aa7-821b-f2e91bec1469 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:03.908677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb01a9ba-d763-4aa7-821b-f2e91bec1469 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:03.909776 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb01a9ba-d763-4aa7-821b-f2e91bec1469 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:03.913253 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb01a9ba-d763-4aa7-821b-f2e91bec1469 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:03.918413 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb01a9ba-d763-4aa7-821b-f2e91bec1469 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:03.929321 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb01a9ba-d763-4aa7-821b-f2e91bec1469 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:03.932563 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb01a9ba-d763-4aa7-821b-f2e91bec1469 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:04.432666 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5512f014-0395-4508-bbf7-db83261b9dda tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:04.441708 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fb01a9ba-d763-4aa7-821b-f2e91bec1469 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:04.468483 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5512f014-0395-4508-bbf7-db83261b9dda tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.910144 Aug 08 16:53:04.474288 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fb01a9ba-d763-4aa7-821b-f2e91bec1469 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1363 microversion: 2.1 time: 0.611549 Aug 08 16:53:04.477865 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 93/196] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:03 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:04.483041 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 104/197] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:03 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1363 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:04.488728 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-26d58bdb-f8e9-4a1d-9932-ffa6ddfd6d55 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:04.490768 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-26d58bdb-f8e9-4a1d-9932-ffa6ddfd6d55 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:04.596549 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-26d58bdb-f8e9-4a1d-9932-ffa6ddfd6d55 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:04.632085 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-26d58bdb-f8e9-4a1d-9932-ffa6ddfd6d55 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1213 microversion: 2.1 time: 0.149568 Aug 08 16:53:04.638684 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 94/198] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:04 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1213 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:05.514443 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0bb73a29-bd80-4b77-98ab-77f519397fea tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:05.515268 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0bb73a29-bd80-4b77-98ab-77f519397fea tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:05.522656 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0bb73a29-bd80-4b77-98ab-77f519397fea tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:05.523307 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0bb73a29-bd80-4b77-98ab-77f519397fea tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:05.523753 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0bb73a29-bd80-4b77-98ab-77f519397fea tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:05.524542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0bb73a29-bd80-4b77-98ab-77f519397fea tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:05.525009 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0bb73a29-bd80-4b77-98ab-77f519397fea tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:05.525449 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0bb73a29-bd80-4b77-98ab-77f519397fea tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:05.532346 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-03edb530-262b-4889-ad47-2010b48f30b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:05.534200 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-03edb530-262b-4889-ad47-2010b48f30b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:05.544724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-03edb530-262b-4889-ad47-2010b48f30b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:05.545926 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-03edb530-262b-4889-ad47-2010b48f30b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:05.546344 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-03edb530-262b-4889-ad47-2010b48f30b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:05.547420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-03edb530-262b-4889-ad47-2010b48f30b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:05.548022 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-03edb530-262b-4889-ad47-2010b48f30b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:05.548989 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-03edb530-262b-4889-ad47-2010b48f30b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:05.767620 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0bb73a29-bd80-4b77-98ab-77f519397fea tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:05.794945 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0bb73a29-bd80-4b77-98ab-77f519397fea tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1549 microversion: 2.1 time: 0.274424 Aug 08 16:53:05.794945 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 105/199] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:05 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1549 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:05.806606 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-56f371b5-6199-4541-a119-69b9b3726309 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:05.807790 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-56f371b5-6199-4541-a119-69b9b3726309 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:05.822147 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f371b5-6199-4541-a119-69b9b3726309 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:05.822964 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f371b5-6199-4541-a119-69b9b3726309 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:05.823776 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f371b5-6199-4541-a119-69b9b3726309 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:05.825078 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f371b5-6199-4541-a119-69b9b3726309 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:05.825897 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f371b5-6199-4541-a119-69b9b3726309 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:05.827161 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f371b5-6199-4541-a119-69b9b3726309 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:05.907243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-03edb530-262b-4889-ad47-2010b48f30b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:05.922185 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-03edb530-262b-4889-ad47-2010b48f30b8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.394106 Aug 08 16:53:05.923669 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 95/200] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:05 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:05.933491 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-92047a94-89bd-4b74-9cac-7980ab3c26d5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:05.934979 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-92047a94-89bd-4b74-9cac-7980ab3c26d5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:05.955820 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-56f371b5-6199-4541-a119-69b9b3726309 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:05.956700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-92047a94-89bd-4b74-9cac-7980ab3c26d5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:05.958115 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-92047a94-89bd-4b74-9cac-7980ab3c26d5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:05.958972 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-92047a94-89bd-4b74-9cac-7980ab3c26d5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:05.961349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-92047a94-89bd-4b74-9cac-7980ab3c26d5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:05.962601 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-92047a94-89bd-4b74-9cac-7980ab3c26d5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:05.963609 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-92047a94-89bd-4b74-9cac-7980ab3c26d5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:05.971054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-56f371b5-6199-4541-a119-69b9b3726309 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1217 microversion: 2.1 time: 0.180677 Aug 08 16:53:05.971764 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 106/201] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:05 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1217 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:06.146491 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-92047a94-89bd-4b74-9cac-7980ab3c26d5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.220559 Aug 08 16:53:06.148144 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 96/202] 10.222.0.13 () {58 vars in 1275 bytes} [Mon Aug 8 16:53:05 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/os-interface => generated 285 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:06.863979 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-9a155b3c-787f-4de3-a5c5-0417ff46f62e req-3adc97bb-ae58-47a1-9950-4bad797f5ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0affcec-8e4c-461a-ac29-5ac8d4fd92bd", "tag": "412ef6d6-1ffe-43de-9f26-f0beb2a5afac"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:06.901328 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-9a155b3c-787f-4de3-a5c5-0417ff46f62e req-3adc97bb-ae58-47a1-9950-4bad797f5ee4 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:06.902547 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-9a155b3c-787f-4de3-a5c5-0417ff46f62e req-3adc97bb-ae58-47a1-9950-4bad797f5ee4 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:06.903648 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-9a155b3c-787f-4de3-a5c5-0417ff46f62e req-3adc97bb-ae58-47a1-9950-4bad797f5ee4 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:06.953759 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-9a155b3c-787f-4de3-a5c5-0417ff46f62e req-3adc97bb-ae58-47a1-9950-4bad797f5ee4 service nova] Creating event network-changed:412ef6d6-1ffe-43de-9f26-f0beb2a5afac for instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd on hv-cinder-85220 Aug 08 16:53:06.960482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ac16ab88-e2b2-4d18-8d97-47a66205d1f9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:06.961497 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ac16ab88-e2b2-4d18-8d97-47a66205d1f9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:06.966074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-9a155b3c-787f-4de3-a5c5-0417ff46f62e req-3adc97bb-ae58-47a1-9950-4bad797f5ee4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113237 Aug 08 16:53:06.969177 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 107/203] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:06.972957 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ac16ab88-e2b2-4d18-8d97-47a66205d1f9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:06.979437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ac16ab88-e2b2-4d18-8d97-47a66205d1f9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:06.987449 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ac16ab88-e2b2-4d18-8d97-47a66205d1f9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:06.994185 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ac16ab88-e2b2-4d18-8d97-47a66205d1f9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:07.007503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-00f81964-70d9-4e7e-b8b0-e1cee244223e tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:07.008583 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-00f81964-70d9-4e7e-b8b0-e1cee244223e tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:07.012447 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ac16ab88-e2b2-4d18-8d97-47a66205d1f9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:07.013134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ac16ab88-e2b2-4d18-8d97-47a66205d1f9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:07.022060 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00f81964-70d9-4e7e-b8b0-e1cee244223e tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:07.022930 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00f81964-70d9-4e7e-b8b0-e1cee244223e tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:07.023665 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00f81964-70d9-4e7e-b8b0-e1cee244223e tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:07.024606 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00f81964-70d9-4e7e-b8b0-e1cee244223e tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:07.025505 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00f81964-70d9-4e7e-b8b0-e1cee244223e tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:07.026138 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00f81964-70d9-4e7e-b8b0-e1cee244223e tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:07.031618 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=100 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:07.206751 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ac16ab88-e2b2-4d18-8d97-47a66205d1f9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:07.225785 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ac16ab88-e2b2-4d18-8d97-47a66205d1f9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.268777 Aug 08 16:53:07.239532 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 97/204] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:06 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:07.353512 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-00f81964-70d9-4e7e-b8b0-e1cee244223e tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:07.369377 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-00f81964-70d9-4e7e-b8b0-e1cee244223e tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1217 microversion: 2.1 time: 0.369061 Aug 08 16:53:07.371010 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 108/205] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:06 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1217 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:08.249370 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b1ececbd-aaf5-4008-b72d-be16c9e15dcd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:08.251568 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b1ececbd-aaf5-4008-b72d-be16c9e15dcd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:08.262423 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b1ececbd-aaf5-4008-b72d-be16c9e15dcd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:08.263200 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b1ececbd-aaf5-4008-b72d-be16c9e15dcd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:08.264011 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b1ececbd-aaf5-4008-b72d-be16c9e15dcd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:08.265123 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b1ececbd-aaf5-4008-b72d-be16c9e15dcd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:08.265691 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b1ececbd-aaf5-4008-b72d-be16c9e15dcd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:08.266158 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b1ececbd-aaf5-4008-b72d-be16c9e15dcd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:08.392584 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d7b6f078-e99c-42f8-aa13-b6d25ba8f274 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:08.395358 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d7b6f078-e99c-42f8-aa13-b6d25ba8f274 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:08.406241 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7b6f078-e99c-42f8-aa13-b6d25ba8f274 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:08.408905 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7b6f078-e99c-42f8-aa13-b6d25ba8f274 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:08.410198 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7b6f078-e99c-42f8-aa13-b6d25ba8f274 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:08.413896 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7b6f078-e99c-42f8-aa13-b6d25ba8f274 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:08.416083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7b6f078-e99c-42f8-aa13-b6d25ba8f274 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:08.419106 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7b6f078-e99c-42f8-aa13-b6d25ba8f274 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:08.648724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b1ececbd-aaf5-4008-b72d-be16c9e15dcd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:08.659825 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d7b6f078-e99c-42f8-aa13-b6d25ba8f274 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:08.675569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b1ececbd-aaf5-4008-b72d-be16c9e15dcd tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.431595 Aug 08 16:53:08.677610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 98/206] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:08 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:08.682439 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d7b6f078-e99c-42f8-aa13-b6d25ba8f274 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1217 microversion: 2.1 time: 0.290733 Aug 08 16:53:08.689096 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-46871040-f360-430f-8df8-d80ce8a97ad2 req-11fd7ddc-4b1f-456b-ad83-4d64dcf944aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba167d3-4013-4e79-8c84-5a72b458b6f7", "tag": "adc434bf-69d7-4da9-9eea-f961d0824299"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:08.697396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 109/207] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:08 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1217 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:08.719226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-46871040-f360-430f-8df8-d80ce8a97ad2 req-11fd7ddc-4b1f-456b-ad83-4d64dcf944aa service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:08.720791 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-46871040-f360-430f-8df8-d80ce8a97ad2 req-11fd7ddc-4b1f-456b-ad83-4d64dcf944aa service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:08.721821 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-46871040-f360-430f-8df8-d80ce8a97ad2 req-11fd7ddc-4b1f-456b-ad83-4d64dcf944aa service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:08.754981 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-46871040-f360-430f-8df8-d80ce8a97ad2 req-11fd7ddc-4b1f-456b-ad83-4d64dcf944aa service nova] Creating event network-changed:adc434bf-69d7-4da9-9eea-f961d0824299 for instance cba167d3-4013-4e79-8c84-5a72b458b6f7 on hv-cinder-85220 Aug 08 16:53:08.778678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-46871040-f360-430f-8df8-d80ce8a97ad2 req-11fd7ddc-4b1f-456b-ad83-4d64dcf944aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098602 Aug 08 16:53:08.781055 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 99/208] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:09.711181 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-328f8248-fa59-4be5-a60a-f243f1a2629a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:09.711928 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-328f8248-fa59-4be5-a60a-f243f1a2629a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:09.728210 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-328f8248-fa59-4be5-a60a-f243f1a2629a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:09.728696 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-328f8248-fa59-4be5-a60a-f243f1a2629a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:09.729326 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-328f8248-fa59-4be5-a60a-f243f1a2629a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:09.730424 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-328f8248-fa59-4be5-a60a-f243f1a2629a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:09.730717 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-dc558a50-113f-404c-a836-640a79ac7915 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:09.731552 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-328f8248-fa59-4be5-a60a-f243f1a2629a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:09.731552 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-328f8248-fa59-4be5-a60a-f243f1a2629a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:09.733486 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-dc558a50-113f-404c-a836-640a79ac7915 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:09.754929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dc558a50-113f-404c-a836-640a79ac7915 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:09.760105 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dc558a50-113f-404c-a836-640a79ac7915 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:09.761076 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dc558a50-113f-404c-a836-640a79ac7915 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:09.762382 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dc558a50-113f-404c-a836-640a79ac7915 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:09.763483 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dc558a50-113f-404c-a836-640a79ac7915 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:09.764261 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dc558a50-113f-404c-a836-640a79ac7915 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:09.815904 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:09.841635 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-328f8248-fa59-4be5-a60a-f243f1a2629a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:09.859445 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-328f8248-fa59-4be5-a60a-f243f1a2629a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1209 microversion: 2.1 time: 0.153579 Aug 08 16:53:09.861728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 110/209] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:09 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1209 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:10.392778 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-dc558a50-113f-404c-a836-640a79ac7915 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:10.417974 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-dc558a50-113f-404c-a836-640a79ac7915 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.705790 Aug 08 16:53:10.419356 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 100/210] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:09 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:10.907006 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6fffb6da-e6ef-49cc-babd-23becffab8c0 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:10.909046 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6fffb6da-e6ef-49cc-babd-23becffab8c0 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:10.918391 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6fffb6da-e6ef-49cc-babd-23becffab8c0 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:10.925811 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6fffb6da-e6ef-49cc-babd-23becffab8c0 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:10.932849 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6fffb6da-e6ef-49cc-babd-23becffab8c0 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:10.934402 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6fffb6da-e6ef-49cc-babd-23becffab8c0 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:10.935542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6fffb6da-e6ef-49cc-babd-23becffab8c0 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:10.936746 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6fffb6da-e6ef-49cc-babd-23becffab8c0 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:11.087682 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6fffb6da-e6ef-49cc-babd-23becffab8c0 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:11.104205 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6fffb6da-e6ef-49cc-babd-23becffab8c0 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1209 microversion: 2.1 time: 0.208975 Aug 08 16:53:11.105455 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 111/211] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:10 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1209 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:11.461558 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-81099b1d-760f-4995-91f1-903458d74831 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:11.463092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-81099b1d-760f-4995-91f1-903458d74831 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:11.472992 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81099b1d-760f-4995-91f1-903458d74831 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:11.473546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81099b1d-760f-4995-91f1-903458d74831 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:11.473994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81099b1d-760f-4995-91f1-903458d74831 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:11.475369 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81099b1d-760f-4995-91f1-903458d74831 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:11.475826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81099b1d-760f-4995-91f1-903458d74831 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:11.476450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81099b1d-760f-4995-91f1-903458d74831 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:11.734988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-81099b1d-760f-4995-91f1-903458d74831 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:11.744965 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-81099b1d-760f-4995-91f1-903458d74831 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.288807 Aug 08 16:53:11.745559 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 101/212] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:11 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:12.140057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-bf9bd445-7242-4c7b-b962-ad6f73b93b94 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:12.148631 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-bf9bd445-7242-4c7b-b962-ad6f73b93b94 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:12.165157 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf9bd445-7242-4c7b-b962-ad6f73b93b94 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:12.166677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf9bd445-7242-4c7b-b962-ad6f73b93b94 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:12.167693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf9bd445-7242-4c7b-b962-ad6f73b93b94 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:12.169456 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf9bd445-7242-4c7b-b962-ad6f73b93b94 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:12.170422 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf9bd445-7242-4c7b-b962-ad6f73b93b94 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:12.171261 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf9bd445-7242-4c7b-b962-ad6f73b93b94 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:12.346117 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bf9bd445-7242-4c7b-b962-ad6f73b93b94 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:12.359144 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-bf9bd445-7242-4c7b-b962-ad6f73b93b94 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1265 microversion: 2.1 time: 0.230595 Aug 08 16:53:12.360284 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 112/213] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:12 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:12.776712 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b9b69c16-03ac-4767-a849-acd3f0cce24e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:12.777550 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b9b69c16-03ac-4767-a849-acd3f0cce24e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:12.784954 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b9b69c16-03ac-4767-a849-acd3f0cce24e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:12.785528 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b9b69c16-03ac-4767-a849-acd3f0cce24e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:12.786230 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b9b69c16-03ac-4767-a849-acd3f0cce24e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:12.788425 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b9b69c16-03ac-4767-a849-acd3f0cce24e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:12.788756 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b9b69c16-03ac-4767-a849-acd3f0cce24e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:12.789363 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b9b69c16-03ac-4767-a849-acd3f0cce24e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:13.135847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b9b69c16-03ac-4767-a849-acd3f0cce24e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:13.150288 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b9b69c16-03ac-4767-a849-acd3f0cce24e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.378975 Aug 08 16:53:13.151416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 102/214] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:12 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:13.393950 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e7e29918-1cde-42c0-937d-4513a28e4c9c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:13.393950 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e7e29918-1cde-42c0-937d-4513a28e4c9c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:13.393950 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:13.393950 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=8 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:13.400306 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e7e29918-1cde-42c0-937d-4513a28e4c9c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:13.400714 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e7e29918-1cde-42c0-937d-4513a28e4c9c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:13.401148 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e7e29918-1cde-42c0-937d-4513a28e4c9c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:13.401864 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e7e29918-1cde-42c0-937d-4513a28e4c9c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:13.402304 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e7e29918-1cde-42c0-937d-4513a28e4c9c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:13.402910 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e7e29918-1cde-42c0-937d-4513a28e4c9c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:13.510657 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e7e29918-1cde-42c0-937d-4513a28e4c9c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:13.527311 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e7e29918-1cde-42c0-937d-4513a28e4c9c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1283 microversion: 2.1 time: 0.141947 Aug 08 16:53:13.539277 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 113/215] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:13 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1283 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:14.194988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8f093893-9e1b-4e01-a77f-c067d1d099b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:14.194988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8f093893-9e1b-4e01-a77f-c067d1d099b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:14.203414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8f093893-9e1b-4e01-a77f-c067d1d099b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:14.204139 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8f093893-9e1b-4e01-a77f-c067d1d099b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:14.204851 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8f093893-9e1b-4e01-a77f-c067d1d099b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:14.206140 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8f093893-9e1b-4e01-a77f-c067d1d099b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:14.206993 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8f093893-9e1b-4e01-a77f-c067d1d099b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:14.207617 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8f093893-9e1b-4e01-a77f-c067d1d099b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:14.455106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8f093893-9e1b-4e01-a77f-c067d1d099b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:14.465154 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8f093893-9e1b-4e01-a77f-c067d1d099b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.279910 Aug 08 16:53:14.467040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 103/216] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:14 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:14.566139 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3165b602-2cc2-4bc3-b805-a8fc78cdbbd9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:14.567067 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3165b602-2cc2-4bc3-b805-a8fc78cdbbd9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:14.575785 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3165b602-2cc2-4bc3-b805-a8fc78cdbbd9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:14.576855 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3165b602-2cc2-4bc3-b805-a8fc78cdbbd9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:14.577415 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3165b602-2cc2-4bc3-b805-a8fc78cdbbd9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:14.578275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3165b602-2cc2-4bc3-b805-a8fc78cdbbd9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:14.578895 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3165b602-2cc2-4bc3-b805-a8fc78cdbbd9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:14.579431 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3165b602-2cc2-4bc3-b805-a8fc78cdbbd9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:14.852485 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3165b602-2cc2-4bc3-b805-a8fc78cdbbd9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:14.871341 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3165b602-2cc2-4bc3-b805-a8fc78cdbbd9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1313 microversion: 2.1 time: 0.308922 Aug 08 16:53:14.888089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 114/217] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:14 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:15.500158 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a5f8656e-2ce7-40cc-95c6-e6973d1594da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:15.501449 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a5f8656e-2ce7-40cc-95c6-e6973d1594da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:15.503435 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:15.511107 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a5f8656e-2ce7-40cc-95c6-e6973d1594da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:15.511843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a5f8656e-2ce7-40cc-95c6-e6973d1594da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:15.518505 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a5f8656e-2ce7-40cc-95c6-e6973d1594da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:15.518505 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a5f8656e-2ce7-40cc-95c6-e6973d1594da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:15.518505 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a5f8656e-2ce7-40cc-95c6-e6973d1594da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:15.518505 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a5f8656e-2ce7-40cc-95c6-e6973d1594da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:15.635497 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-938f0251-1cad-44f0-8110-9f59ab6d413a req-e88f5603-b5d3-4a9c-9764-ce1c445ed3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02c7b77-d425-4176-b5c2-dc2fc49803b7", "tag": "a6521096-2057-4d47-b348-cc8d4a2b3f2c"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:15.671079 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-938f0251-1cad-44f0-8110-9f59ab6d413a req-e88f5603-b5d3-4a9c-9764-ce1c445ed3a9 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:15.673835 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-938f0251-1cad-44f0-8110-9f59ab6d413a req-e88f5603-b5d3-4a9c-9764-ce1c445ed3a9 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:15.675104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-938f0251-1cad-44f0-8110-9f59ab6d413a req-e88f5603-b5d3-4a9c-9764-ce1c445ed3a9 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:15.704439 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-938f0251-1cad-44f0-8110-9f59ab6d413a req-e88f5603-b5d3-4a9c-9764-ce1c445ed3a9 service nova] Creating event network-changed:a6521096-2057-4d47-b348-cc8d4a2b3f2c for instance d02c7b77-d425-4176-b5c2-dc2fc49803b7 on hv-cinder-85220 Aug 08 16:53:15.715115 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-938f0251-1cad-44f0-8110-9f59ab6d413a req-e88f5603-b5d3-4a9c-9764-ce1c445ed3a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093119 Aug 08 16:53:15.716123 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 115/218] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:15.775589 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a5f8656e-2ce7-40cc-95c6-e6973d1594da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:15.783918 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a5f8656e-2ce7-40cc-95c6-e6973d1594da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.288441 Aug 08 16:53:15.784518 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 104/219] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:15 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:15.908387 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-33b19623-3bc6-41a0-9f87-976c21d54144 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:15.909133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-33b19623-3bc6-41a0-9f87-976c21d54144 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:15.916894 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-33b19623-3bc6-41a0-9f87-976c21d54144 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:15.917386 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-33b19623-3bc6-41a0-9f87-976c21d54144 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:15.917946 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-33b19623-3bc6-41a0-9f87-976c21d54144 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:15.918767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-33b19623-3bc6-41a0-9f87-976c21d54144 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:15.931689 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-33b19623-3bc6-41a0-9f87-976c21d54144 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:15.932134 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-33b19623-3bc6-41a0-9f87-976c21d54144 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:16.192645 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-33b19623-3bc6-41a0-9f87-976c21d54144 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:16.203283 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-33b19623-3bc6-41a0-9f87-976c21d54144 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1313 microversion: 2.1 time: 0.299195 Aug 08 16:53:16.204000 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 116/220] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:15 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:16.818532 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a90832d2-62c7-4fcc-8d36-bcd860993404 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:16.819441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a90832d2-62c7-4fcc-8d36-bcd860993404 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:16.828317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a90832d2-62c7-4fcc-8d36-bcd860993404 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:16.828888 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a90832d2-62c7-4fcc-8d36-bcd860993404 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:16.829478 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a90832d2-62c7-4fcc-8d36-bcd860993404 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:16.830528 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a90832d2-62c7-4fcc-8d36-bcd860993404 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:16.831258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a90832d2-62c7-4fcc-8d36-bcd860993404 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:16.831815 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a90832d2-62c7-4fcc-8d36-bcd860993404 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:17.064919 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a90832d2-62c7-4fcc-8d36-bcd860993404 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:17.074615 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a90832d2-62c7-4fcc-8d36-bcd860993404 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.264426 Aug 08 16:53:17.075111 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 105/221] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:16 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:17.228864 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-23e8e67b-9e57-4395-a211-cbe2f7fcee60 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:17.229944 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-23e8e67b-9e57-4395-a211-cbe2f7fcee60 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:17.238105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-23e8e67b-9e57-4395-a211-cbe2f7fcee60 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:17.238895 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-23e8e67b-9e57-4395-a211-cbe2f7fcee60 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:17.240643 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-23e8e67b-9e57-4395-a211-cbe2f7fcee60 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:17.241474 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-23e8e67b-9e57-4395-a211-cbe2f7fcee60 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:17.242018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-23e8e67b-9e57-4395-a211-cbe2f7fcee60 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:17.242592 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-23e8e67b-9e57-4395-a211-cbe2f7fcee60 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:17.466768 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-23e8e67b-9e57-4395-a211-cbe2f7fcee60 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:17.481961 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-23e8e67b-9e57-4395-a211-cbe2f7fcee60 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1313 microversion: 2.1 time: 0.258057 Aug 08 16:53:17.483115 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 117/222] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:17 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:18.100732 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fa991c1c-25fb-4173-9145-f68e5b3c2dab tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:18.101794 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fa991c1c-25fb-4173-9145-f68e5b3c2dab tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:18.115594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa991c1c-25fb-4173-9145-f68e5b3c2dab tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:18.116858 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa991c1c-25fb-4173-9145-f68e5b3c2dab tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:18.117771 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa991c1c-25fb-4173-9145-f68e5b3c2dab tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:18.119475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa991c1c-25fb-4173-9145-f68e5b3c2dab tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:18.120324 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa991c1c-25fb-4173-9145-f68e5b3c2dab tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:18.121075 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa991c1c-25fb-4173-9145-f68e5b3c2dab tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:18.322737 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fa991c1c-25fb-4173-9145-f68e5b3c2dab tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:18.334743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fa991c1c-25fb-4173-9145-f68e5b3c2dab tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.241646 Aug 08 16:53:18.335706 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 106/223] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:18 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:18.507821 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e1ff70fb-ffdc-45fd-aa3d-11c0d158df4c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:18.508703 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e1ff70fb-ffdc-45fd-aa3d-11c0d158df4c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:18.525623 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e1ff70fb-ffdc-45fd-aa3d-11c0d158df4c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:18.525623 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e1ff70fb-ffdc-45fd-aa3d-11c0d158df4c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:18.525623 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e1ff70fb-ffdc-45fd-aa3d-11c0d158df4c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:18.525623 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e1ff70fb-ffdc-45fd-aa3d-11c0d158df4c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:18.526189 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e1ff70fb-ffdc-45fd-aa3d-11c0d158df4c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:18.526189 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e1ff70fb-ffdc-45fd-aa3d-11c0d158df4c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:18.854514 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e1ff70fb-ffdc-45fd-aa3d-11c0d158df4c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:18.880144 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e1ff70fb-ffdc-45fd-aa3d-11c0d158df4c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1313 microversion: 2.1 time: 0.377528 Aug 08 16:53:18.881292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 118/224] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:18 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:19.364463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7cc33b1e-b63f-4e81-9f97-4583b29f7bed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:19.366307 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7cc33b1e-b63f-4e81-9f97-4583b29f7bed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:19.375376 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7cc33b1e-b63f-4e81-9f97-4583b29f7bed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:19.376304 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7cc33b1e-b63f-4e81-9f97-4583b29f7bed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:19.377182 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7cc33b1e-b63f-4e81-9f97-4583b29f7bed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:19.377982 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7cc33b1e-b63f-4e81-9f97-4583b29f7bed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:19.378508 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7cc33b1e-b63f-4e81-9f97-4583b29f7bed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:19.379087 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7cc33b1e-b63f-4e81-9f97-4583b29f7bed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:19.612080 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7cc33b1e-b63f-4e81-9f97-4583b29f7bed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:19.628806 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7cc33b1e-b63f-4e81-9f97-4583b29f7bed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.271062 Aug 08 16:53:19.629728 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 107/225] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:19 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:19.934512 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-875e346e-38d8-4e4f-9ac2-9ddbefaaac59 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:19.935503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-875e346e-38d8-4e4f-9ac2-9ddbefaaac59 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:19.945662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-875e346e-38d8-4e4f-9ac2-9ddbefaaac59 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:19.945662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-875e346e-38d8-4e4f-9ac2-9ddbefaaac59 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:19.945920 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-875e346e-38d8-4e4f-9ac2-9ddbefaaac59 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:19.951637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-875e346e-38d8-4e4f-9ac2-9ddbefaaac59 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:19.952171 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-875e346e-38d8-4e4f-9ac2-9ddbefaaac59 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:19.952612 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-875e346e-38d8-4e4f-9ac2-9ddbefaaac59 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:20.148838 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-875e346e-38d8-4e4f-9ac2-9ddbefaaac59 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:20.172803 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-875e346e-38d8-4e4f-9ac2-9ddbefaaac59 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1313 microversion: 2.1 time: 0.240547 Aug 08 16:53:20.173845 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 119/226] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:19 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:20.666679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c16c229c-8257-4e64-8609-6a16f7cd8754 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:20.669063 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c16c229c-8257-4e64-8609-6a16f7cd8754 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:20.680536 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c16c229c-8257-4e64-8609-6a16f7cd8754 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:20.681786 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c16c229c-8257-4e64-8609-6a16f7cd8754 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:20.682101 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c16c229c-8257-4e64-8609-6a16f7cd8754 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:20.685507 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c16c229c-8257-4e64-8609-6a16f7cd8754 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:20.687442 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c16c229c-8257-4e64-8609-6a16f7cd8754 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:20.687442 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c16c229c-8257-4e64-8609-6a16f7cd8754 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:20.917774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c16c229c-8257-4e64-8609-6a16f7cd8754 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:20.928793 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c16c229c-8257-4e64-8609-6a16f7cd8754 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.266646 Aug 08 16:53:20.931645 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 108/227] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:20 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:21.197903 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3ec55e9d-bf7f-4beb-81bc-46131d9d6017 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:21.199417 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3ec55e9d-bf7f-4beb-81bc-46131d9d6017 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:21.212954 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3ec55e9d-bf7f-4beb-81bc-46131d9d6017 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:21.216048 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3ec55e9d-bf7f-4beb-81bc-46131d9d6017 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:21.217271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3ec55e9d-bf7f-4beb-81bc-46131d9d6017 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:21.219196 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3ec55e9d-bf7f-4beb-81bc-46131d9d6017 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:21.220616 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3ec55e9d-bf7f-4beb-81bc-46131d9d6017 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:21.221780 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3ec55e9d-bf7f-4beb-81bc-46131d9d6017 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:21.524775 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3ec55e9d-bf7f-4beb-81bc-46131d9d6017 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:21.535173 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3ec55e9d-bf7f-4beb-81bc-46131d9d6017 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1313 microversion: 2.1 time: 0.341398 Aug 08 16:53:21.535173 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 120/228] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:21 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:21.952356 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-59fcb800-f709-455c-a582-c927c5361901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:21.953186 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-59fcb800-f709-455c-a582-c927c5361901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:21.961848 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-59fcb800-f709-455c-a582-c927c5361901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:21.963307 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-59fcb800-f709-455c-a582-c927c5361901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:21.964176 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-59fcb800-f709-455c-a582-c927c5361901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:21.965419 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-59fcb800-f709-455c-a582-c927c5361901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:21.966212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-59fcb800-f709-455c-a582-c927c5361901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:21.966975 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-59fcb800-f709-455c-a582-c927c5361901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:22.208973 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-59fcb800-f709-455c-a582-c927c5361901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:22.228274 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-59fcb800-f709-455c-a582-c927c5361901 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.279584 Aug 08 16:53:22.229610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 109/229] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:21 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:22.378437 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4ccf0d73-db49-40f1-a787-6455d39efe38 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:22.379158 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4ccf0d73-db49-40f1-a787-6455d39efe38 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:22.386720 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4ccf0d73-db49-40f1-a787-6455d39efe38 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:22.387220 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4ccf0d73-db49-40f1-a787-6455d39efe38 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:22.387656 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4ccf0d73-db49-40f1-a787-6455d39efe38 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:22.388364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4ccf0d73-db49-40f1-a787-6455d39efe38 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:22.388819 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4ccf0d73-db49-40f1-a787-6455d39efe38 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:22.389268 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4ccf0d73-db49-40f1-a787-6455d39efe38 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:22.417990 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4ccf0d73-db49-40f1-a787-6455d39efe38 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:53:22.561646 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1f3658cb-197e-466f-9eff-8258ce0e423c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:22.562267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1f3658cb-197e-466f-9eff-8258ce0e423c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:22.568902 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1f3658cb-197e-466f-9eff-8258ce0e423c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:22.569409 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1f3658cb-197e-466f-9eff-8258ce0e423c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:22.569851 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1f3658cb-197e-466f-9eff-8258ce0e423c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:22.570589 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1f3658cb-197e-466f-9eff-8258ce0e423c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:22.572925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1f3658cb-197e-466f-9eff-8258ce0e423c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:22.572925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1f3658cb-197e-466f-9eff-8258ce0e423c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:22.772198 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1f3658cb-197e-466f-9eff-8258ce0e423c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:22.790025 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1f3658cb-197e-466f-9eff-8258ce0e423c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1313 microversion: 2.1 time: 0.231312 Aug 08 16:53:22.792520 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 110/230] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:22 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:22.827732 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:22.957109 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4ccf0d73-db49-40f1-a787-6455d39efe38 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 204 len: 0 microversion: 2.1 time: 0.581689 Aug 08 16:53:22.959388 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 121/231] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:53:22 2022] DELETE /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 16:53:22.969999 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-dd04d196-6ea7-49d6-bfbd-9fd2dfef5dfa tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:22.971152 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-dd04d196-6ea7-49d6-bfbd-9fd2dfef5dfa tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:22.984821 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd04d196-6ea7-49d6-bfbd-9fd2dfef5dfa tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:22.986725 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd04d196-6ea7-49d6-bfbd-9fd2dfef5dfa tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:22.989998 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd04d196-6ea7-49d6-bfbd-9fd2dfef5dfa tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:22.993631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd04d196-6ea7-49d6-bfbd-9fd2dfef5dfa tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:22.995007 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd04d196-6ea7-49d6-bfbd-9fd2dfef5dfa tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:22.997224 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd04d196-6ea7-49d6-bfbd-9fd2dfef5dfa tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:23.273702 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-980d3fa7-0ffb-4015-8e99-35ce14e3bc38 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:23.276560 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-980d3fa7-0ffb-4015-8e99-35ce14e3bc38 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:23.315628 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-980d3fa7-0ffb-4015-8e99-35ce14e3bc38 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:23.316848 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-980d3fa7-0ffb-4015-8e99-35ce14e3bc38 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:23.320174 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-980d3fa7-0ffb-4015-8e99-35ce14e3bc38 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:23.323149 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-980d3fa7-0ffb-4015-8e99-35ce14e3bc38 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:23.324341 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-980d3fa7-0ffb-4015-8e99-35ce14e3bc38 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:23.325089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-980d3fa7-0ffb-4015-8e99-35ce14e3bc38 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:23.345861 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-dd04d196-6ea7-49d6-bfbd-9fd2dfef5dfa tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:23.369038 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-dd04d196-6ea7-49d6-bfbd-9fd2dfef5dfa tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1555 microversion: 2.1 time: 0.403552 Aug 08 16:53:23.382613 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 111/232] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:22 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1555 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:23.492513 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-e6176e10-2961-4dc9-82b0-1b0a95fb2e3d req-78eb3902-5468-4990-b6e1-238a2ea93b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02c7b77-d425-4176-b5c2-dc2fc49803b7", "name": "network-vif-plugged", "status": "completed", "tag": "a6521096-2057-4d47-b348-cc8d4a2b3f2c"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:23.503986 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e6176e10-2961-4dc9-82b0-1b0a95fb2e3d req-78eb3902-5468-4990-b6e1-238a2ea93b23 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:23.515215 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e6176e10-2961-4dc9-82b0-1b0a95fb2e3d req-78eb3902-5468-4990-b6e1-238a2ea93b23 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:23.515215 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e6176e10-2961-4dc9-82b0-1b0a95fb2e3d req-78eb3902-5468-4990-b6e1-238a2ea93b23 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:23.523116 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-e6176e10-2961-4dc9-82b0-1b0a95fb2e3d req-78eb3902-5468-4990-b6e1-238a2ea93b23 service nova] Creating event network-vif-plugged:a6521096-2057-4d47-b348-cc8d4a2b3f2c for instance d02c7b77-d425-4176-b5c2-dc2fc49803b7 on hv-cinder-85220 Aug 08 16:53:23.528945 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-e6176e10-2961-4dc9-82b0-1b0a95fb2e3d req-78eb3902-5468-4990-b6e1-238a2ea93b23 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040924 Aug 08 16:53:23.529763 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 112/233] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:23.744866 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-980d3fa7-0ffb-4015-8e99-35ce14e3bc38 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:23.761457 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-980d3fa7-0ffb-4015-8e99-35ce14e3bc38 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.498040 Aug 08 16:53:23.763010 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 122/234] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:23 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:23.820546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2584889c-8255-4711-8988-55d1d678fc0f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:23.822272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2584889c-8255-4711-8988-55d1d678fc0f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:23.832146 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2584889c-8255-4711-8988-55d1d678fc0f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:23.832989 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2584889c-8255-4711-8988-55d1d678fc0f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:23.834119 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2584889c-8255-4711-8988-55d1d678fc0f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:23.835602 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2584889c-8255-4711-8988-55d1d678fc0f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:23.836644 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2584889c-8255-4711-8988-55d1d678fc0f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:23.837416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2584889c-8255-4711-8988-55d1d678fc0f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:24.074853 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2584889c-8255-4711-8988-55d1d678fc0f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:24.089237 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2584889c-8255-4711-8988-55d1d678fc0f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1313 microversion: 2.1 time: 0.277088 Aug 08 16:53:24.090251 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 113/235] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:23 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:24.412601 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-72d6fc58-7b80-4c7c-bdb6-dad6ebbb3bec tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:24.413741 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-72d6fc58-7b80-4c7c-bdb6-dad6ebbb3bec tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:24.421929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-72d6fc58-7b80-4c7c-bdb6-dad6ebbb3bec tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:24.422682 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-72d6fc58-7b80-4c7c-bdb6-dad6ebbb3bec tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:24.423150 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-72d6fc58-7b80-4c7c-bdb6-dad6ebbb3bec tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:24.427876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-72d6fc58-7b80-4c7c-bdb6-dad6ebbb3bec tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:24.427876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-72d6fc58-7b80-4c7c-bdb6-dad6ebbb3bec tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:24.427876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-72d6fc58-7b80-4c7c-bdb6-dad6ebbb3bec tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:24.651759 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-72d6fc58-7b80-4c7c-bdb6-dad6ebbb3bec tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:24.656960 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:24.669015 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-72d6fc58-7b80-4c7c-bdb6-dad6ebbb3bec tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1555 microversion: 2.1 time: 0.262819 Aug 08 16:53:24.670373 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 123/236] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:24 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1555 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:24.785393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d86e54ad-def5-40dd-99cb-b3ade80612ed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:24.787053 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d86e54ad-def5-40dd-99cb-b3ade80612ed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:24.793939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d86e54ad-def5-40dd-99cb-b3ade80612ed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:24.794439 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d86e54ad-def5-40dd-99cb-b3ade80612ed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:24.794912 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d86e54ad-def5-40dd-99cb-b3ade80612ed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:24.795640 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d86e54ad-def5-40dd-99cb-b3ade80612ed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:24.796143 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d86e54ad-def5-40dd-99cb-b3ade80612ed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:24.796573 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d86e54ad-def5-40dd-99cb-b3ade80612ed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:24.961362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d86e54ad-def5-40dd-99cb-b3ade80612ed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:24.970393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d86e54ad-def5-40dd-99cb-b3ade80612ed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.189768 Aug 08 16:53:24.975710 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 114/237] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:24 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:25.121674 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c87147ed-70af-4a46-bc1f-509296149b19 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:25.124167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c87147ed-70af-4a46-bc1f-509296149b19 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:25.136678 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c87147ed-70af-4a46-bc1f-509296149b19 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:25.137565 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c87147ed-70af-4a46-bc1f-509296149b19 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:25.138340 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c87147ed-70af-4a46-bc1f-509296149b19 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:25.139665 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c87147ed-70af-4a46-bc1f-509296149b19 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:25.140541 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c87147ed-70af-4a46-bc1f-509296149b19 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:25.141768 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c87147ed-70af-4a46-bc1f-509296149b19 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:25.364713 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c87147ed-70af-4a46-bc1f-509296149b19 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:25.383963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c87147ed-70af-4a46-bc1f-509296149b19 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1313 microversion: 2.1 time: 0.272651 Aug 08 16:53:25.385712 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 124/238] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:25 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:25.716430 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-18a47f1a-42df-4164-b3ed-0b966d92251b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:25.720309 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-18a47f1a-42df-4164-b3ed-0b966d92251b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:25.751605 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-18a47f1a-42df-4164-b3ed-0b966d92251b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:25.752365 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-18a47f1a-42df-4164-b3ed-0b966d92251b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:25.753175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-18a47f1a-42df-4164-b3ed-0b966d92251b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:25.754386 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-18a47f1a-42df-4164-b3ed-0b966d92251b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:25.755525 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-18a47f1a-42df-4164-b3ed-0b966d92251b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:25.756099 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-18a47f1a-42df-4164-b3ed-0b966d92251b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:25.999051 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7439f184-ee25-474e-934b-86c34fca18dc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:26.000806 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7439f184-ee25-474e-934b-86c34fca18dc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:26.013887 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7439f184-ee25-474e-934b-86c34fca18dc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:26.015413 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7439f184-ee25-474e-934b-86c34fca18dc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:26.016734 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7439f184-ee25-474e-934b-86c34fca18dc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:26.018301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7439f184-ee25-474e-934b-86c34fca18dc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:26.019501 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7439f184-ee25-474e-934b-86c34fca18dc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:26.021072 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7439f184-ee25-474e-934b-86c34fca18dc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:26.054129 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-18a47f1a-42df-4164-b3ed-0b966d92251b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:26.070036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-18a47f1a-42df-4164-b3ed-0b966d92251b tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1555 microversion: 2.1 time: 0.360708 Aug 08 16:53:26.070926 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 115/239] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:25 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1555 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:26.290820 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7439f184-ee25-474e-934b-86c34fca18dc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:26.300562 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7439f184-ee25-474e-934b-86c34fca18dc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.311902 Aug 08 16:53:26.301565 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 125/240] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:25 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:26.420465 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d85b815b-7518-4f4c-ac21-48c980f172b2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:26.422103 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d85b815b-7518-4f4c-ac21-48c980f172b2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:26.432174 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d85b815b-7518-4f4c-ac21-48c980f172b2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:26.432869 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d85b815b-7518-4f4c-ac21-48c980f172b2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:26.433524 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d85b815b-7518-4f4c-ac21-48c980f172b2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:26.434386 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d85b815b-7518-4f4c-ac21-48c980f172b2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:26.435204 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d85b815b-7518-4f4c-ac21-48c980f172b2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:26.436022 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d85b815b-7518-4f4c-ac21-48c980f172b2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:26.619607 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d85b815b-7518-4f4c-ac21-48c980f172b2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:26.628152 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d85b815b-7518-4f4c-ac21-48c980f172b2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1313 microversion: 2.1 time: 0.217918 Aug 08 16:53:26.628756 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 116/241] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:26 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:27.110447 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6b881879-99e0-4a2b-acbd-d358ecf68ab2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:27.111093 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6b881879-99e0-4a2b-acbd-d358ecf68ab2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:27.119093 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b881879-99e0-4a2b-acbd-d358ecf68ab2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:27.119585 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b881879-99e0-4a2b-acbd-d358ecf68ab2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:27.119995 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b881879-99e0-4a2b-acbd-d358ecf68ab2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:27.120709 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b881879-99e0-4a2b-acbd-d358ecf68ab2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:27.121160 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b881879-99e0-4a2b-acbd-d358ecf68ab2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:27.121598 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b881879-99e0-4a2b-acbd-d358ecf68ab2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:27.334776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7b2761f3-0b66-4791-9fd1-36401310b3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:27.344382 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7b2761f3-0b66-4791-9fd1-36401310b3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:27.348804 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b2761f3-0b66-4791-9fd1-36401310b3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:27.349751 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b2761f3-0b66-4791-9fd1-36401310b3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:27.350945 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b2761f3-0b66-4791-9fd1-36401310b3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:27.352278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b2761f3-0b66-4791-9fd1-36401310b3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:27.353123 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b2761f3-0b66-4791-9fd1-36401310b3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:27.353894 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b2761f3-0b66-4791-9fd1-36401310b3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:27.397389 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=100 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:27.480622 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6b881879-99e0-4a2b-acbd-d358ecf68ab2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:27.502093 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6b881879-99e0-4a2b-acbd-d358ecf68ab2 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1555 microversion: 2.1 time: 0.395212 Aug 08 16:53:27.503767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 126/242] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:27 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1555 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:27.626724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7b2761f3-0b66-4791-9fd1-36401310b3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:27.637161 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7b2761f3-0b66-4791-9fd1-36401310b3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.316499 Aug 08 16:53:27.638013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 117/243] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:27 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:27.653607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-86cbbad8-ca63-4911-8c85-7bf72767fdb1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:27.654413 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-86cbbad8-ca63-4911-8c85-7bf72767fdb1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:27.662723 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86cbbad8-ca63-4911-8c85-7bf72767fdb1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:27.663233 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86cbbad8-ca63-4911-8c85-7bf72767fdb1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:27.663678 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86cbbad8-ca63-4911-8c85-7bf72767fdb1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:27.664527 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86cbbad8-ca63-4911-8c85-7bf72767fdb1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:27.664992 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86cbbad8-ca63-4911-8c85-7bf72767fdb1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:27.665430 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86cbbad8-ca63-4911-8c85-7bf72767fdb1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:27.916938 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-86cbbad8-ca63-4911-8c85-7bf72767fdb1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:27.960835 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-86cbbad8-ca63-4911-8c85-7bf72767fdb1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1313 microversion: 2.1 time: 0.312405 Aug 08 16:53:27.962512 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 127/244] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:27 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:28.086429 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-42a8a11e-0de9-48d2-85a7-44760e7ecc29 req-37263a14-80c1-4121-9ce6-cea83800fad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9c648c-c4ed-45bc-8333-5f0646d9e6eb", "name": "network-vif-deleted", "tag": "c16259a2-eb59-46c3-b743-600832fe35f7"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:28.105008 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-42a8a11e-0de9-48d2-85a7-44760e7ecc29 req-37263a14-80c1-4121-9ce6-cea83800fad5 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:28.106272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-42a8a11e-0de9-48d2-85a7-44760e7ecc29 req-37263a14-80c1-4121-9ce6-cea83800fad5 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:28.111695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-42a8a11e-0de9-48d2-85a7-44760e7ecc29 req-37263a14-80c1-4121-9ce6-cea83800fad5 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:28.136820 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-42a8a11e-0de9-48d2-85a7-44760e7ecc29 req-37263a14-80c1-4121-9ce6-cea83800fad5 service nova] Creating event network-vif-deleted:c16259a2-eb59-46c3-b743-600832fe35f7 for instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb on hv-cinder-85220 Aug 08 16:53:28.144526 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-42a8a11e-0de9-48d2-85a7-44760e7ecc29 req-37263a14-80c1-4121-9ce6-cea83800fad5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064247 Aug 08 16:53:28.145989 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 118/245] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:53:28.543049 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1d82edec-291c-4cf5-b141-fd9f65bd97f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:28.545225 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1d82edec-291c-4cf5-b141-fd9f65bd97f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:28.557886 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1d82edec-291c-4cf5-b141-fd9f65bd97f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:28.558998 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1d82edec-291c-4cf5-b141-fd9f65bd97f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:28.559863 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1d82edec-291c-4cf5-b141-fd9f65bd97f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:28.561288 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1d82edec-291c-4cf5-b141-fd9f65bd97f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:28.563269 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1d82edec-291c-4cf5-b141-fd9f65bd97f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:28.563269 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1d82edec-291c-4cf5-b141-fd9f65bd97f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:28.668047 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f76baec5-cb0c-4cf3-b71d-3d1f067fc08f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:28.670374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f76baec5-cb0c-4cf3-b71d-3d1f067fc08f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:28.680136 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1d82edec-291c-4cf5-b141-fd9f65bd97f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:28.682747 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f76baec5-cb0c-4cf3-b71d-3d1f067fc08f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:28.683698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f76baec5-cb0c-4cf3-b71d-3d1f067fc08f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:28.684721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f76baec5-cb0c-4cf3-b71d-3d1f067fc08f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:28.686163 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f76baec5-cb0c-4cf3-b71d-3d1f067fc08f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:28.689026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f76baec5-cb0c-4cf3-b71d-3d1f067fc08f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:28.689026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f76baec5-cb0c-4cf3-b71d-3d1f067fc08f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:28.690954 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1d82edec-291c-4cf5-b141-fd9f65bd97f7 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1513 microversion: 2.1 time: 0.156145 Aug 08 16:53:28.691762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 128/246] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:28 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:28.948850 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f76baec5-cb0c-4cf3-b71d-3d1f067fc08f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:28.961112 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f76baec5-cb0c-4cf3-b71d-3d1f067fc08f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.301585 Aug 08 16:53:28.962182 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 119/247] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:28 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:28.992541 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-cd26c560-446d-454b-b021-6bfe629c728a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:28.993192 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-cd26c560-446d-454b-b021-6bfe629c728a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:29.007275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cd26c560-446d-454b-b021-6bfe629c728a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:29.008055 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cd26c560-446d-454b-b021-6bfe629c728a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:29.008635 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cd26c560-446d-454b-b021-6bfe629c728a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:29.015151 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cd26c560-446d-454b-b021-6bfe629c728a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:29.015151 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cd26c560-446d-454b-b021-6bfe629c728a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:29.015151 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cd26c560-446d-454b-b021-6bfe629c728a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:29.190334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-cd26c560-446d-454b-b021-6bfe629c728a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:29.204394 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-cd26c560-446d-454b-b021-6bfe629c728a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1498 microversion: 2.1 time: 0.217617 Aug 08 16:53:29.205260 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 129/248] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:28 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1498 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:29.715391 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-132b076b-2d22-452d-9a8f-1297a7b2aaad tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:29.715992 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-132b076b-2d22-452d-9a8f-1297a7b2aaad tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:29.722765 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-132b076b-2d22-452d-9a8f-1297a7b2aaad tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:29.723249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-132b076b-2d22-452d-9a8f-1297a7b2aaad tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:29.723690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-132b076b-2d22-452d-9a8f-1297a7b2aaad tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:29.724554 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-132b076b-2d22-452d-9a8f-1297a7b2aaad tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:29.725076 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-132b076b-2d22-452d-9a8f-1297a7b2aaad tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:29.725505 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-132b076b-2d22-452d-9a8f-1297a7b2aaad tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:29.796036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-132b076b-2d22-452d-9a8f-1297a7b2aaad tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:29.806256 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-132b076b-2d22-452d-9a8f-1297a7b2aaad tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1346 microversion: 2.1 time: 0.094745 Aug 08 16:53:29.806890 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 120/249] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:29 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:29.993051 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c8abdb4b-eb9e-421a-a1a8-a9c09b563ecf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:29.993660 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c8abdb4b-eb9e-421a-a1a8-a9c09b563ecf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:30.000254 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8abdb4b-eb9e-421a-a1a8-a9c09b563ecf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:30.000792 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8abdb4b-eb9e-421a-a1a8-a9c09b563ecf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:30.001417 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8abdb4b-eb9e-421a-a1a8-a9c09b563ecf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:30.002280 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8abdb4b-eb9e-421a-a1a8-a9c09b563ecf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:30.002826 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8abdb4b-eb9e-421a-a1a8-a9c09b563ecf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:30.003289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8abdb4b-eb9e-421a-a1a8-a9c09b563ecf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:30.165409 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c8abdb4b-eb9e-421a-a1a8-a9c09b563ecf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:30.168116 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c8abdb4b-eb9e-421a-a1a8-a9c09b563ecf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.179714 Aug 08 16:53:30.168725 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 130/250] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:29 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:30.828332 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1ad380b5-495a-4a2d-9ed4-7752006f944c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:30.829009 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1ad380b5-495a-4a2d-9ed4-7752006f944c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:30.837370 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ad380b5-495a-4a2d-9ed4-7752006f944c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:30.837870 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ad380b5-495a-4a2d-9ed4-7752006f944c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:30.838306 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ad380b5-495a-4a2d-9ed4-7752006f944c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:30.839050 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ad380b5-495a-4a2d-9ed4-7752006f944c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:30.839500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ad380b5-495a-4a2d-9ed4-7752006f944c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:30.839919 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ad380b5-495a-4a2d-9ed4-7752006f944c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:30.906906 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1ad380b5-495a-4a2d-9ed4-7752006f944c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:30.920535 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1ad380b5-495a-4a2d-9ed4-7752006f944c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1346 microversion: 2.1 time: 0.096170 Aug 08 16:53:30.921563 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 121/251] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:30 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:31.196217 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-66196cf4-bb09-4078-84de-034a830d722a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:31.196868 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-66196cf4-bb09-4078-84de-034a830d722a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:31.203607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-66196cf4-bb09-4078-84de-034a830d722a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:31.204096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-66196cf4-bb09-4078-84de-034a830d722a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:31.204539 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-66196cf4-bb09-4078-84de-034a830d722a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:31.205264 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-66196cf4-bb09-4078-84de-034a830d722a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:31.205722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-66196cf4-bb09-4078-84de-034a830d722a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:31.206143 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-66196cf4-bb09-4078-84de-034a830d722a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:31.356139 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-66196cf4-bb09-4078-84de-034a830d722a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:31.371473 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-66196cf4-bb09-4078-84de-034a830d722a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.179731 Aug 08 16:53:31.372566 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 131/252] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:31 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:31.949918 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b49e6a4f-089d-4222-83a7-c5485c4a771d tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:31.950968 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b49e6a4f-089d-4222-83a7-c5485c4a771d tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:31.957949 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b49e6a4f-089d-4222-83a7-c5485c4a771d tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:31.958685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b49e6a4f-089d-4222-83a7-c5485c4a771d tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:31.959125 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b49e6a4f-089d-4222-83a7-c5485c4a771d tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:31.959835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b49e6a4f-089d-4222-83a7-c5485c4a771d tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:31.960292 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b49e6a4f-089d-4222-83a7-c5485c4a771d tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:31.960714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b49e6a4f-089d-4222-83a7-c5485c4a771d tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:32.031317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b49e6a4f-089d-4222-83a7-c5485c4a771d tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:32.042078 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b49e6a4f-089d-4222-83a7-c5485c4a771d tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1346 microversion: 2.1 time: 0.096452 Aug 08 16:53:32.044097 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 122/253] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:31 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:32.393457 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5dd873f0-4b42-49c6-8f88-96b82379d57f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:32.394076 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5dd873f0-4b42-49c6-8f88-96b82379d57f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:32.401272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5dd873f0-4b42-49c6-8f88-96b82379d57f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:32.401824 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5dd873f0-4b42-49c6-8f88-96b82379d57f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:32.402271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5dd873f0-4b42-49c6-8f88-96b82379d57f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:32.403010 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5dd873f0-4b42-49c6-8f88-96b82379d57f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:32.403500 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5dd873f0-4b42-49c6-8f88-96b82379d57f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:32.403897 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5dd873f0-4b42-49c6-8f88-96b82379d57f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:32.556653 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-5dd873f0-4b42-49c6-8f88-96b82379d57f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:32.565063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5dd873f0-4b42-49c6-8f88-96b82379d57f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.175459 Aug 08 16:53:32.565658 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 132/254] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:32 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:33.064119 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f82a46ae-ff74-4e1e-ae9d-9f2a6d798cfe tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:33.064787 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f82a46ae-ff74-4e1e-ae9d-9f2a6d798cfe tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:33.068520 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=68 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:33.074320 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f82a46ae-ff74-4e1e-ae9d-9f2a6d798cfe tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:33.074851 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f82a46ae-ff74-4e1e-ae9d-9f2a6d798cfe tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:33.075587 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f82a46ae-ff74-4e1e-ae9d-9f2a6d798cfe tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:33.076364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f82a46ae-ff74-4e1e-ae9d-9f2a6d798cfe tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:33.076849 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f82a46ae-ff74-4e1e-ae9d-9f2a6d798cfe tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:33.077272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f82a46ae-ff74-4e1e-ae9d-9f2a6d798cfe tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:33.144936 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f82a46ae-ff74-4e1e-ae9d-9f2a6d798cfe tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:33.153957 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f82a46ae-ff74-4e1e-ae9d-9f2a6d798cfe tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1346 microversion: 2.1 time: 0.093888 Aug 08 16:53:33.154534 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 123/255] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:33 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:33.588487 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-49685a10-3998-45b0-880d-c113107e5700 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:33.589146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-49685a10-3998-45b0-880d-c113107e5700 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:33.595693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49685a10-3998-45b0-880d-c113107e5700 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:33.596290 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49685a10-3998-45b0-880d-c113107e5700 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:33.596732 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49685a10-3998-45b0-880d-c113107e5700 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:33.597431 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49685a10-3998-45b0-880d-c113107e5700 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:33.598163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49685a10-3998-45b0-880d-c113107e5700 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:33.599239 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49685a10-3998-45b0-880d-c113107e5700 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:33.757558 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-49685a10-3998-45b0-880d-c113107e5700 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:33.777767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-49685a10-3998-45b0-880d-c113107e5700 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.192144 Aug 08 16:53:33.781878 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 133/256] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:33 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:34.177214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:34.178045 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:34.187055 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:34.187872 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:34.188557 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:34.189742 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:34.190545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:34.191107 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:34.237287 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:34.238085 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:34.238713 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:34.239342 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lazy-loading 'fault' on Instance uuid 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:53:34.295489 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5891c6b280bd4ad68ef411759fcdec46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8beb878fb0d489cb0a2cf4a569bf475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:34.308258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4a2214f4-d0b3-4431-a9cf-32c726461e88 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 200 len: 1351 microversion: 2.1 time: 0.136291 Aug 08 16:53:34.308940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 124/257] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:34 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 1351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:34.811781 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b0255a46-e9f4-4f82-9309-ba4dbb8634f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:34.813805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b0255a46-e9f4-4f82-9309-ba4dbb8634f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:34.824464 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0255a46-e9f4-4f82-9309-ba4dbb8634f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:34.826068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0255a46-e9f4-4f82-9309-ba4dbb8634f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:34.826791 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0255a46-e9f4-4f82-9309-ba4dbb8634f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:34.827835 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0255a46-e9f4-4f82-9309-ba4dbb8634f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:34.828728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0255a46-e9f4-4f82-9309-ba4dbb8634f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:34.829257 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0255a46-e9f4-4f82-9309-ba4dbb8634f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:34.951180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a0ef7bb7-68ac-4e31-9d0a-71b0bd8236b8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:34.951967 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a0ef7bb7-68ac-4e31-9d0a-71b0bd8236b8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:34.959287 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a0ef7bb7-68ac-4e31-9d0a-71b0bd8236b8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:34.960087 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a0ef7bb7-68ac-4e31-9d0a-71b0bd8236b8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:34.960671 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a0ef7bb7-68ac-4e31-9d0a-71b0bd8236b8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:34.961556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a0ef7bb7-68ac-4e31-9d0a-71b0bd8236b8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:34.962149 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a0ef7bb7-68ac-4e31-9d0a-71b0bd8236b8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:34.962753 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a0ef7bb7-68ac-4e31-9d0a-71b0bd8236b8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:34.993844 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a0ef7bb7-68ac-4e31-9d0a-71b0bd8236b8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Going to try to terminate instance {{(pid=130235) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:53:34.996643 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b0255a46-e9f4-4f82-9309-ba4dbb8634f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:35.004880 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b0255a46-e9f4-4f82-9309-ba4dbb8634f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.198010 Aug 08 16:53:35.005552 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 134/258] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:34 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:35.335649 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3ba7133e-8b62-4c86-a769-eb2948126c8c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:35.336775 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3ba7133e-8b62-4c86-a769-eb2948126c8c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:35.348429 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3ba7133e-8b62-4c86-a769-eb2948126c8c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:35.349289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3ba7133e-8b62-4c86-a769-eb2948126c8c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:35.350048 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3ba7133e-8b62-4c86-a769-eb2948126c8c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:35.351417 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3ba7133e-8b62-4c86-a769-eb2948126c8c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:35.352359 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3ba7133e-8b62-4c86-a769-eb2948126c8c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:35.353181 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3ba7133e-8b62-4c86-a769-eb2948126c8c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:35.372192 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-3ba7133e-8b62-4c86-a769-eb2948126c8c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] HTTP exception thrown: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3ba7133e-8b62-4c86-a769-eb2948126c8c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Request method failure captured: Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb HTTP/1.1 Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T81OeKMGmJeUqiASKigYFwxDm-QjqeU4o52D8mexZKbrSzVd5rPTqZx3-WKtpgds0HJ2isoxsVXtrmdFsyZyslReYg9ljSfe5SMpCh9-ZRKO_YGXM_CQFaIm2HwTCOhikfQ_ufKrCcFCXR2ao69mPD5zbCBOywBRvRKrLSgP51Ins4 Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: e8beb878fb0d489cb0a2cf4a569bf475 Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-DeleteServersTestJSON-1226484710 Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 16:53:35.378349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 16:53:35.386077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e8beb878fb0d489cb0a2cf4a569bf475", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e8beb878fb0d489cb0a2cf4a569bf475"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8beb878fb0d489cb0a2cf4a569bf475"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8beb878fb0d489cb0a2cf4a569bf475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:53:35.386077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-DeleteServersTestJSON-1226484710 Aug 08 16:53:35.386077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: e8beb878fb0d489cb0a2cf4a569bf475 Aug 08 16:53:35.386077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-DeleteServersTestJSON-1226484710 Aug 08 16:53:35.386077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-DeleteServersTestJSON-1226484710-project Aug 08 16:53:35.386077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 16:53:35.386077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 16:53:35.386077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: 5891c6b280bd4ad68ef411759fcdec46 Aug 08 16:53:35.386077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-DeleteServersTestJSON-1226484710-project Aug 08 16:53:35.386077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 16:53:35.386077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:35.386077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': '6d9c648c-c4ed-45bc-8333-5f0646d9e6eb'} Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:53:35.400427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:35.402332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:53:35.405159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3ba7133e-8b62-4c86-a769-eb2948126c8c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Returning 404 to user: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:53:35.405159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3ba7133e-8b62-4c86-a769-eb2948126c8c tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 404 len: 111 microversion: 2.1 time: 0.053635 Aug 08 16:53:35.405159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 135/259] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:35 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 16:53:35.405570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a0ef7bb7-68ac-4e31-9d0a-71b0bd8236b8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 204 len: 0 microversion: 2.1 time: 0.444001 Aug 08 16:53:35.405570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 125/260] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:53:34 2022] DELETE /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 16:53:35.409768 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7249b4ce-5d45-48bd-b4b6-4988a795d3a2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:35.411239 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7249b4ce-5d45-48bd-b4b6-4988a795d3a2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:35.421590 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7249b4ce-5d45-48bd-b4b6-4988a795d3a2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:35.422094 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7249b4ce-5d45-48bd-b4b6-4988a795d3a2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:35.425999 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7249b4ce-5d45-48bd-b4b6-4988a795d3a2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:35.425999 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7249b4ce-5d45-48bd-b4b6-4988a795d3a2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:35.425999 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7249b4ce-5d45-48bd-b4b6-4988a795d3a2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:35.425999 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7249b4ce-5d45-48bd-b4b6-4988a795d3a2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:35.537982 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-cb40e99f-3df5-412a-b666-7ce84fc22ac0 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:35.540377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-cb40e99f-3df5-412a-b666-7ce84fc22ac0 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:35.546792 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cb40e99f-3df5-412a-b666-7ce84fc22ac0 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:35.547283 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cb40e99f-3df5-412a-b666-7ce84fc22ac0 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:35.547715 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cb40e99f-3df5-412a-b666-7ce84fc22ac0 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:35.548423 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cb40e99f-3df5-412a-b666-7ce84fc22ac0 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:35.548871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cb40e99f-3df5-412a-b666-7ce84fc22ac0 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:35.549292 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cb40e99f-3df5-412a-b666-7ce84fc22ac0 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:35.565184 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-cb40e99f-3df5-412a-b666-7ce84fc22ac0 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] HTTP exception thrown: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-cb40e99f-3df5-412a-b666-7ce84fc22ac0 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Request method failure captured: Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb/os-volume_attachments HTTP/1.1 Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T81OeKMGmJeUqiASKigYFwxDm-QjqeU4o52D8mexZKbrSzVd5rPTqZx3-WKtpgds0HJ2isoxsVXtrmdFsyZyslReYg9ljSfe5SMpCh9-ZRKO_YGXM_CQFaIm2HwTCOhikfQ_ufKrCcFCXR2ao69mPD5zbCBOywBRvRKrLSgP51Ins4 Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: e8beb878fb0d489cb0a2cf4a569bf475 Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-DeleteServersTestJSON-1226484710 Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:53:35.570385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:53:35.572899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e8beb878fb0d489cb0a2cf4a569bf475", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e8beb878fb0d489cb0a2cf4a569bf475"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8beb878fb0d489cb0a2cf4a569bf475"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8beb878fb0d489cb0a2cf4a569bf475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:53:35.572899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-DeleteServersTestJSON-1226484710 Aug 08 16:53:35.572899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: e8beb878fb0d489cb0a2cf4a569bf475 Aug 08 16:53:35.572899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1226484710 Aug 08 16:53:35.572899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-DeleteServersTestJSON-1226484710-project Aug 08 16:53:35.572899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:53:35.572899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:53:35.572899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: 5891c6b280bd4ad68ef411759fcdec46 Aug 08 16:53:35.572899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-DeleteServersTestJSON-1226484710-project Aug 08 16:53:35.572899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:53:35.572899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:35.572899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'server_id': '6d9c648c-c4ed-45bc-8333-5f0646d9e6eb'} Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:53:35.574234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:35.576604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:35.577871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-cb40e99f-3df5-412a-b666-7ce84fc22ac0 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Returning 404 to user: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:53:35.577871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-cb40e99f-3df5-412a-b666-7ce84fc22ac0 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039633 Aug 08 16:53:35.577871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 126/261] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:53:35 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 16:53:35.646022 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7249b4ce-5d45-48bd-b4b6-4988a795d3a2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:35.666424 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7249b4ce-5d45-48bd-b4b6-4988a795d3a2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1504 microversion: 2.1 time: 0.262045 Aug 08 16:53:35.667746 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 136/262] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:35 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:36.037020 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d6b285af-6543-4bcb-b91f-33ba1846d22a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:36.037988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d6b285af-6543-4bcb-b91f-33ba1846d22a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:36.044957 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d6b285af-6543-4bcb-b91f-33ba1846d22a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:36.045868 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d6b285af-6543-4bcb-b91f-33ba1846d22a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:36.046090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d6b285af-6543-4bcb-b91f-33ba1846d22a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:36.046943 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d6b285af-6543-4bcb-b91f-33ba1846d22a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:36.047543 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d6b285af-6543-4bcb-b91f-33ba1846d22a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:36.048131 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d6b285af-6543-4bcb-b91f-33ba1846d22a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:36.255503 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d6b285af-6543-4bcb-b91f-33ba1846d22a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:36.265846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d6b285af-6543-4bcb-b91f-33ba1846d22a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.241184 Aug 08 16:53:36.267086 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 127/263] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:36 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:36.708518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7f74d62e-11a2-4bc4-9755-43e6552587a7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:36.709701 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7f74d62e-11a2-4bc4-9755-43e6552587a7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:36.721352 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7f74d62e-11a2-4bc4-9755-43e6552587a7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:36.722236 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7f74d62e-11a2-4bc4-9755-43e6552587a7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:36.723942 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7f74d62e-11a2-4bc4-9755-43e6552587a7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:36.726013 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7f74d62e-11a2-4bc4-9755-43e6552587a7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:36.731814 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7f74d62e-11a2-4bc4-9755-43e6552587a7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:36.731814 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7f74d62e-11a2-4bc4-9755-43e6552587a7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:37.159254 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7f74d62e-11a2-4bc4-9755-43e6552587a7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:37.168341 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7f74d62e-11a2-4bc4-9755-43e6552587a7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1504 microversion: 2.1 time: 0.468416 Aug 08 16:53:37.169173 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 137/264] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:36 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1504 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:37.291387 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-30b24b9f-a20b-4972-a693-74e60cd452fc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:37.292928 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-30b24b9f-a20b-4972-a693-74e60cd452fc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:37.301545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-30b24b9f-a20b-4972-a693-74e60cd452fc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:37.302548 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-30b24b9f-a20b-4972-a693-74e60cd452fc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:37.303035 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-30b24b9f-a20b-4972-a693-74e60cd452fc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:37.304304 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-30b24b9f-a20b-4972-a693-74e60cd452fc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:37.304304 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-30b24b9f-a20b-4972-a693-74e60cd452fc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:37.304831 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-30b24b9f-a20b-4972-a693-74e60cd452fc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:37.500616 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-30b24b9f-a20b-4972-a693-74e60cd452fc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:37.510354 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-30b24b9f-a20b-4972-a693-74e60cd452fc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.223652 Aug 08 16:53:37.511060 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 128/265] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:37 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:38.194055 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-02abbf2b-3941-473a-b133-9ffa3cfd7480 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:38.194709 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-02abbf2b-3941-473a-b133-9ffa3cfd7480 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:38.201615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-02abbf2b-3941-473a-b133-9ffa3cfd7480 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:38.202101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-02abbf2b-3941-473a-b133-9ffa3cfd7480 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:38.202535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-02abbf2b-3941-473a-b133-9ffa3cfd7480 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:38.203291 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-02abbf2b-3941-473a-b133-9ffa3cfd7480 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:38.203740 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-02abbf2b-3941-473a-b133-9ffa3cfd7480 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:38.204164 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-02abbf2b-3941-473a-b133-9ffa3cfd7480 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:38.384732 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-02abbf2b-3941-473a-b133-9ffa3cfd7480 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:38.393367 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-02abbf2b-3941-473a-b133-9ffa3cfd7480 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1504 microversion: 2.1 time: 0.204448 Aug 08 16:53:38.394097 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 138/266] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:38 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:38.547592 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-46ef5794-8d29-4d48-b2b7-50022d1115f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:38.548189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-46ef5794-8d29-4d48-b2b7-50022d1115f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:38.557334 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-46ef5794-8d29-4d48-b2b7-50022d1115f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:38.557789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-46ef5794-8d29-4d48-b2b7-50022d1115f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:38.558225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-46ef5794-8d29-4d48-b2b7-50022d1115f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:38.558975 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-46ef5794-8d29-4d48-b2b7-50022d1115f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:38.559427 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-46ef5794-8d29-4d48-b2b7-50022d1115f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:38.559847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-46ef5794-8d29-4d48-b2b7-50022d1115f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:38.733753 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-46ef5794-8d29-4d48-b2b7-50022d1115f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:38.744130 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-46ef5794-8d29-4d48-b2b7-50022d1115f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.200506 Aug 08 16:53:38.744832 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 129/267] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:38 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:39.430826 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e80064da-c211-4abf-9af0-a479ef1b7fdc tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:39.431955 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e80064da-c211-4abf-9af0-a479ef1b7fdc tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:39.441077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e80064da-c211-4abf-9af0-a479ef1b7fdc tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:39.441948 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e80064da-c211-4abf-9af0-a479ef1b7fdc tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:39.442273 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e80064da-c211-4abf-9af0-a479ef1b7fdc tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:39.443164 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e80064da-c211-4abf-9af0-a479ef1b7fdc tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:39.443633 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e80064da-c211-4abf-9af0-a479ef1b7fdc tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:39.444062 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e80064da-c211-4abf-9af0-a479ef1b7fdc tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:39.627333 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e80064da-c211-4abf-9af0-a479ef1b7fdc tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:39.636287 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e80064da-c211-4abf-9af0-a479ef1b7fdc tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1504 microversion: 2.1 time: 0.210467 Aug 08 16:53:39.640533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 139/268] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:39 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:39.770334 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5de321b5-a385-4b1f-9654-d02fa3b431ad tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:39.771659 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5de321b5-a385-4b1f-9654-d02fa3b431ad tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:39.778471 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5de321b5-a385-4b1f-9654-d02fa3b431ad tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:39.779003 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5de321b5-a385-4b1f-9654-d02fa3b431ad tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:39.779450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5de321b5-a385-4b1f-9654-d02fa3b431ad tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:39.780245 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5de321b5-a385-4b1f-9654-d02fa3b431ad tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:39.780701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5de321b5-a385-4b1f-9654-d02fa3b431ad tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:39.781131 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5de321b5-a385-4b1f-9654-d02fa3b431ad tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:40.171084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5de321b5-a385-4b1f-9654-d02fa3b431ad tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:40.187453 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5de321b5-a385-4b1f-9654-d02fa3b431ad tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.421276 Aug 08 16:53:40.205291 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 130/269] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:39 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:40.247006 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1b76c95b-e6cf-4d68-a15a-aabe3fd19258 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:40.247841 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1b76c95b-e6cf-4d68-a15a-aabe3fd19258 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:40.258740 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1b76c95b-e6cf-4d68-a15a-aabe3fd19258 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:40.259556 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1b76c95b-e6cf-4d68-a15a-aabe3fd19258 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:40.260401 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1b76c95b-e6cf-4d68-a15a-aabe3fd19258 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:40.261824 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1b76c95b-e6cf-4d68-a15a-aabe3fd19258 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:40.262662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1b76c95b-e6cf-4d68-a15a-aabe3fd19258 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:40.263437 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1b76c95b-e6cf-4d68-a15a-aabe3fd19258 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:40.292577 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-1b76c95b-e6cf-4d68-a15a-aabe3fd19258 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] HTTP exception thrown: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1b76c95b-e6cf-4d68-a15a-aabe3fd19258 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Request method failure captured: Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: DELETE /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb HTTP/1.1 Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T81OeKMGmJeUqiASKigYFwxDm-QjqeU4o52D8mexZKbrSzVd5rPTqZx3-WKtpgds0HJ2isoxsVXtrmdFsyZyslReYg9ljSfe5SMpCh9-ZRKO_YGXM_CQFaIm2HwTCOhikfQ_ufKrCcFCXR2ao69mPD5zbCBOywBRvRKrLSgP51Ins4 Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: e8beb878fb0d489cb0a2cf4a569bf475 Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-DeleteServersTestJSON-1226484710 Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 16:53:40.295929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 16:53:40.297292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e8beb878fb0d489cb0a2cf4a569bf475", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e8beb878fb0d489cb0a2cf4a569bf475"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8beb878fb0d489cb0a2cf4a569bf475"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8beb878fb0d489cb0a2cf4a569bf475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:53:40.297292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-DeleteServersTestJSON-1226484710 Aug 08 16:53:40.297292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: e8beb878fb0d489cb0a2cf4a569bf475 Aug 08 16:53:40.297292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-DeleteServersTestJSON-1226484710 Aug 08 16:53:40.297292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-DeleteServersTestJSON-1226484710-project Aug 08 16:53:40.297292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 16:53:40.297292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 16:53:40.297292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: 5891c6b280bd4ad68ef411759fcdec46 Aug 08 16:53:40.297292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-DeleteServersTestJSON-1226484710-project Aug 08 16:53:40.297292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 16:53:40.297292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:40.297292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': '6d9c648c-c4ed-45bc-8333-5f0646d9e6eb'} Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:53:40.298088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:40.304662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:53:40.306188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1b76c95b-e6cf-4d68-a15a-aabe3fd19258 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Returning 404 to user: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:53:40.306188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1b76c95b-e6cf-4d68-a15a-aabe3fd19258 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 404 len: 111 microversion: 2.1 time: 0.056763 Aug 08 16:53:40.306188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 140/270] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:53:40 2022] DELETE /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:53:40.311459 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3c17d940-326f-419a-95cb-312b2e734334 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:40.312319 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-3c17d940-326f-419a-95cb-312b2e734334 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] [instance: 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:40.321260 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3c17d940-326f-419a-95cb-312b2e734334 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:40.324249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3c17d940-326f-419a-95cb-312b2e734334 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:40.324249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3c17d940-326f-419a-95cb-312b2e734334 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:40.324249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3c17d940-326f-419a-95cb-312b2e734334 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:40.324759 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3c17d940-326f-419a-95cb-312b2e734334 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:40.325196 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3c17d940-326f-419a-95cb-312b2e734334 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:40.343149 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-3c17d940-326f-419a-95cb-312b2e734334 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] HTTP exception thrown: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3c17d940-326f-419a-95cb-312b2e734334 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Request method failure captured: Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb HTTP/1.1 Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T81OeKMGmJeUqiASKigYFwxDm-QjqeU4o52D8mexZKbrSzVd5rPTqZx3-WKtpgds0HJ2isoxsVXtrmdFsyZyslReYg9ljSfe5SMpCh9-ZRKO_YGXM_CQFaIm2HwTCOhikfQ_ufKrCcFCXR2ao69mPD5zbCBOywBRvRKrLSgP51Ins4 Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: e8beb878fb0d489cb0a2cf4a569bf475 Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-DeleteServersTestJSON-1226484710 Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:53:40.345987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:53:40.349377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e8beb878fb0d489cb0a2cf4a569bf475", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e8beb878fb0d489cb0a2cf4a569bf475"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8beb878fb0d489cb0a2cf4a569bf475"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8beb878fb0d489cb0a2cf4a569bf475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:53:40.349377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-DeleteServersTestJSON-1226484710 Aug 08 16:53:40.349377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: e8beb878fb0d489cb0a2cf4a569bf475 Aug 08 16:53:40.349377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-DeleteServersTestJSON-1226484710 Aug 08 16:53:40.349377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-DeleteServersTestJSON-1226484710-project Aug 08 16:53:40.349377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:53:40.349377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:53:40.349377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: 5891c6b280bd4ad68ef411759fcdec46 Aug 08 16:53:40.349377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-DeleteServersTestJSON-1226484710-project Aug 08 16:53:40.349377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:53:40.349377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:40.349377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '6d9c648c-c4ed-45bc-8333-5f0646d9e6eb'} Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:53:40.355180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. Aug 08 16:53:40.357695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:40.360355 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3c17d940-326f-419a-95cb-312b2e734334 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] Returning 404 to user: Instance 6d9c648c-c4ed-45bc-8333-5f0646d9e6eb could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:53:40.360355 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-3c17d940-326f-419a-95cb-312b2e734334 tempest-DeleteServersTestJSON-1226484710 tempest-DeleteServersTestJSON-1226484710-project] 10.222.0.13 "GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb" status: 404 len: 111 microversion: 2.1 time: 0.042369 Aug 08 16:53:40.360355 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 131/271] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:40 2022] GET /compute/v2.1/servers/6d9c648c-c4ed-45bc-8333-5f0646d9e6eb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:53:40.663090 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f88dcf27-e72a-469a-bd04-398639e422a1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:40.664323 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f88dcf27-e72a-469a-bd04-398639e422a1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:40.673762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f88dcf27-e72a-469a-bd04-398639e422a1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:40.674544 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f88dcf27-e72a-469a-bd04-398639e422a1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:40.675198 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f88dcf27-e72a-469a-bd04-398639e422a1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:40.676399 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f88dcf27-e72a-469a-bd04-398639e422a1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:40.677118 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f88dcf27-e72a-469a-bd04-398639e422a1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:40.677975 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f88dcf27-e72a-469a-bd04-398639e422a1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:41.033672 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f88dcf27-e72a-469a-bd04-398639e422a1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:41.039583 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=100 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:41.045962 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f88dcf27-e72a-469a-bd04-398639e422a1 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1504 microversion: 2.1 time: 0.388868 Aug 08 16:53:41.051451 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 141/272] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:40 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:41.229680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ff557095-e733-4332-8b9c-d469e34e65b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:41.230794 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ff557095-e733-4332-8b9c-d469e34e65b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:41.240870 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff557095-e733-4332-8b9c-d469e34e65b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:41.241756 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff557095-e733-4332-8b9c-d469e34e65b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:41.242289 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff557095-e733-4332-8b9c-d469e34e65b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:41.243230 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff557095-e733-4332-8b9c-d469e34e65b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:41.244002 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff557095-e733-4332-8b9c-d469e34e65b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:41.244741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff557095-e733-4332-8b9c-d469e34e65b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:41.461284 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ff557095-e733-4332-8b9c-d469e34e65b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:41.470646 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ff557095-e733-4332-8b9c-d469e34e65b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.250240 Aug 08 16:53:41.471219 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 132/273] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:41 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:42.068634 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a112efb4-5af3-44e2-99e2-ae7f0527ab4b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:42.074322 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a112efb4-5af3-44e2-99e2-ae7f0527ab4b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:42.078550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a112efb4-5af3-44e2-99e2-ae7f0527ab4b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:42.079142 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a112efb4-5af3-44e2-99e2-ae7f0527ab4b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:42.079647 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a112efb4-5af3-44e2-99e2-ae7f0527ab4b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:42.080428 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a112efb4-5af3-44e2-99e2-ae7f0527ab4b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:42.080952 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a112efb4-5af3-44e2-99e2-ae7f0527ab4b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:42.081526 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a112efb4-5af3-44e2-99e2-ae7f0527ab4b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:42.497029 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5f264173-d11e-4bdc-b75a-8d24151492de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:42.497765 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5f264173-d11e-4bdc-b75a-8d24151492de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:42.506157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5f264173-d11e-4bdc-b75a-8d24151492de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:42.506692 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5f264173-d11e-4bdc-b75a-8d24151492de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:42.507142 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5f264173-d11e-4bdc-b75a-8d24151492de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:42.507882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5f264173-d11e-4bdc-b75a-8d24151492de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:42.508348 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5f264173-d11e-4bdc-b75a-8d24151492de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:42.508805 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5f264173-d11e-4bdc-b75a-8d24151492de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:42.677897 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5f264173-d11e-4bdc-b75a-8d24151492de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:42.695565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5f264173-d11e-4bdc-b75a-8d24151492de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.202249 Aug 08 16:53:42.696732 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 133/274] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:42 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:42.942215 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a112efb4-5af3-44e2-99e2-ae7f0527ab4b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:42.956033 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a112efb4-5af3-44e2-99e2-ae7f0527ab4b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1504 microversion: 2.1 time: 0.891731 Aug 08 16:53:42.957551 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 142/275] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:42 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1504 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:43.546130 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-78076a9f-cd6c-4e77-bbf8-840333685744 req-6091bc17-7484-4d12-8e84-a4f7343961db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02c7b77-d425-4176-b5c2-dc2fc49803b7", "name": "network-vif-deleted", "tag": "a6521096-2057-4d47-b348-cc8d4a2b3f2c"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:43.559416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-78076a9f-cd6c-4e77-bbf8-840333685744 req-6091bc17-7484-4d12-8e84-a4f7343961db service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:43.559920 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-78076a9f-cd6c-4e77-bbf8-840333685744 req-6091bc17-7484-4d12-8e84-a4f7343961db service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:43.560602 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-78076a9f-cd6c-4e77-bbf8-840333685744 req-6091bc17-7484-4d12-8e84-a4f7343961db service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:43.565099 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:43.574283 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-78076a9f-cd6c-4e77-bbf8-840333685744 req-6091bc17-7484-4d12-8e84-a4f7343961db service nova] Creating event network-vif-deleted:a6521096-2057-4d47-b348-cc8d4a2b3f2c for instance d02c7b77-d425-4176-b5c2-dc2fc49803b7 on hv-cinder-85220 Aug 08 16:53:43.580146 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-78076a9f-cd6c-4e77-bbf8-840333685744 req-6091bc17-7484-4d12-8e84-a4f7343961db service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038343 Aug 08 16:53:43.580773 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 134/276] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:53:43.721394 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ecfe4a82-d639-4473-9c6e-e65e64349fe2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:43.722641 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ecfe4a82-d639-4473-9c6e-e65e64349fe2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:43.734777 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ecfe4a82-d639-4473-9c6e-e65e64349fe2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:43.738252 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ecfe4a82-d639-4473-9c6e-e65e64349fe2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:43.738252 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ecfe4a82-d639-4473-9c6e-e65e64349fe2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:43.738252 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ecfe4a82-d639-4473-9c6e-e65e64349fe2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:43.739122 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ecfe4a82-d639-4473-9c6e-e65e64349fe2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:43.739690 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ecfe4a82-d639-4473-9c6e-e65e64349fe2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:43.985604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:43.987102 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:44.005992 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:44.007117 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:44.007808 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:44.009278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:44.010015 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:44.010756 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:44.065003 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:44.070128 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:44.070778 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:44.071929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lazy-loading 'fault' on Instance uuid d02c7b77-d425-4176-b5c2-dc2fc49803b7 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:53:44.115487 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ecfe4a82-d639-4473-9c6e-e65e64349fe2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:44.150311 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ecfe4a82-d639-4473-9c6e-e65e64349fe2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.435629 Aug 08 16:53:44.169679 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 143/277] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:43 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:44.253869 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:44.269986 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9344c4b9-2e72-4508-afcd-6ed0bfaa194b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 200 len: 1303 microversion: 2.1 time: 0.293604 Aug 08 16:53:44.271198 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 135/278] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:43 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 1303 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:45.195418 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0b5060a0-51a9-492f-b6fc-c9b9ae384bd2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:45.197888 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0b5060a0-51a9-492f-b6fc-c9b9ae384bd2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:45.213081 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b5060a0-51a9-492f-b6fc-c9b9ae384bd2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:45.213956 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b5060a0-51a9-492f-b6fc-c9b9ae384bd2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:45.215081 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b5060a0-51a9-492f-b6fc-c9b9ae384bd2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:45.217993 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b5060a0-51a9-492f-b6fc-c9b9ae384bd2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:45.217993 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b5060a0-51a9-492f-b6fc-c9b9ae384bd2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:45.218650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b5060a0-51a9-492f-b6fc-c9b9ae384bd2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:45.319349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-636a34e8-dd9b-4e20-b8a3-8461caaf15a5 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:45.324687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-636a34e8-dd9b-4e20-b8a3-8461caaf15a5 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: d02c7b77-d425-4176-b5c2-dc2fc49803b7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:45.368147 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-636a34e8-dd9b-4e20-b8a3-8461caaf15a5 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:45.375047 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-636a34e8-dd9b-4e20-b8a3-8461caaf15a5 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:45.376253 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-636a34e8-dd9b-4e20-b8a3-8461caaf15a5 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:45.382248 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-636a34e8-dd9b-4e20-b8a3-8461caaf15a5 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:45.385566 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-636a34e8-dd9b-4e20-b8a3-8461caaf15a5 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:45.392454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-636a34e8-dd9b-4e20-b8a3-8461caaf15a5 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:45.430453 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0b5060a0-51a9-492f-b6fc-c9b9ae384bd2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:45.444696 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0b5060a0-51a9-492f-b6fc-c9b9ae384bd2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.259886 Aug 08 16:53:45.458618 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 144/279] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:45 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-636a34e8-dd9b-4e20-b8a3-8461caaf15a5 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] HTTP exception thrown: Instance d02c7b77-d425-4176-b5c2-dc2fc49803b7 could not be found. Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-636a34e8-dd9b-4e20-b8a3-8461caaf15a5 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Request method failure captured: Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 HTTP/1.1 Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T9nhTXjoZVr6DubgpdSMvlYYqbY6ZXcfwCLHBZcaOa2CZvgX1hPijPdKGv8Op5fjR34LcU9iYWLDakahINRSejSYvEZ_XRIPJF1YHOWnp_UupDjDUHQdL1Z9QMcgKvAWK_B7XX3hopR3pdFsqr1B0NBHvLrhKeWrCoO5tL69C6Hk5U Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: ec57970389084368ac985ecb58645bd1 Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-VolumesActionsTest-328226349 Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:53:45.467088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:53:45.469743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec57970389084368ac985ecb58645bd1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec57970389084368ac985ecb58645bd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec57970389084368ac985ecb58645bd1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec57970389084368ac985ecb58645bd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:53:45.469743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-VolumesActionsTest-328226349 Aug 08 16:53:45.469743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: ec57970389084368ac985ecb58645bd1 Aug 08 16:53:45.469743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-VolumesActionsTest-328226349 Aug 08 16:53:45.469743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-VolumesActionsTest-328226349-project Aug 08 16:53:45.469743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:53:45.469743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:53:45.469743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: 00fdea0388e34b1eb5bfff49a3de5b57 Aug 08 16:53:45.469743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-VolumesActionsTest-328226349-project Aug 08 16:53:45.469743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:53:45.469743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance d02c7b77-d425-4176-b5c2-dc2fc49803b7 could not be found. Aug 08 16:53:45.469743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'd02c7b77-d425-4176-b5c2-dc2fc49803b7'} Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02c7b77-d425-4176-b5c2-dc2fc49803b7 could not be found. Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:53:45.479823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02c7b77-d425-4176-b5c2-dc2fc49803b7 could not be found. Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02c7b77-d425-4176-b5c2-dc2fc49803b7 could not be found. Aug 08 16:53:45.482414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:53:45.484956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-636a34e8-dd9b-4e20-b8a3-8461caaf15a5 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Returning 404 to user: Instance d02c7b77-d425-4176-b5c2-dc2fc49803b7 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:53:45.484956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-636a34e8-dd9b-4e20-b8a3-8461caaf15a5 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7" status: 404 len: 111 microversion: 2.1 time: 0.147335 Aug 08 16:53:45.484956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 136/280] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:45 2022] GET /compute/v2.1/servers/d02c7b77-d425-4176-b5c2-dc2fc49803b7 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:53:45.742051 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1908598663", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "networks": [{"uuid": "f95845c5-c55e-4114-8c1e-fabee2ca7763"}]}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:45.805630 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.network.neutron [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] validate_networks() for [('f95845c5-c55e-4114-8c1e-fabee2ca7763', None, None, None, None, None)] {{(pid=130236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:53:46.455946 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Flavor limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:53:46.455946 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Image limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:53:46.455946 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Flavor pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:53:46.455946 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Image pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:53:46.458527 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:53:46.479692 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:46.480940 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:46.481976 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:46.483744 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:46.484593 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:46.498830 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:46.500629 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-15c043e0-3044-4229-b20c-19ed54ee72f5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:46.501726 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-15c043e0-3044-4229-b20c-19ed54ee72f5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:46.522082 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-15c043e0-3044-4229-b20c-19ed54ee72f5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:46.523173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-15c043e0-3044-4229-b20c-19ed54ee72f5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:46.523866 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-15c043e0-3044-4229-b20c-19ed54ee72f5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:46.524787 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-15c043e0-3044-4229-b20c-19ed54ee72f5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:46.525521 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-15c043e0-3044-4229-b20c-19ed54ee72f5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:46.526477 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-15c043e0-3044-4229-b20c-19ed54ee72f5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:46.578555 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Getting quotas for project ec57970389084368ac985ecb58645bd1. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:53:46.584408 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Getting quotas for user 00fdea0388e34b1eb5bfff49a3de5b57 and project ec57970389084368ac985ecb58645bd1. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:53:46.598488 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Going to run 1 instances... {{(pid=130236) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:53:46.601009 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:53:46.855697 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-15c043e0-3044-4229-b20c-19ed54ee72f5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:46.870940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-15c043e0-3044-4229-b20c-19ed54ee72f5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.377017 Aug 08 16:53:46.873571 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4918310a-067d-4e3e-80c6-6aaecaec8ff4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.136614 Aug 08 16:53:46.874556 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 145/281] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:53:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 16:53:46.898683 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 137/282] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:46 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:46.905653 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f6fb8775-5306-47bb-a58c-b17ee13fd801 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:46.907004 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f6fb8775-5306-47bb-a58c-b17ee13fd801 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:46.998418 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f6fb8775-5306-47bb-a58c-b17ee13fd801 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:47.013872 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f6fb8775-5306-47bb-a58c-b17ee13fd801 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1214 microversion: 2.1 time: 0.122249 Aug 08 16:53:47.030070 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 146/283] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:46 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1214 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:47.908893 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0e898c10-913a-42a6-9d89-39ba9ce3199e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:47.912344 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0e898c10-913a-42a6-9d89-39ba9ce3199e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:47.925375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e898c10-913a-42a6-9d89-39ba9ce3199e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:47.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e898c10-913a-42a6-9d89-39ba9ce3199e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:47.929013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e898c10-913a-42a6-9d89-39ba9ce3199e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:47.930132 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e898c10-913a-42a6-9d89-39ba9ce3199e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:47.931389 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e898c10-913a-42a6-9d89-39ba9ce3199e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:47.932481 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e898c10-913a-42a6-9d89-39ba9ce3199e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:48.045101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-71cec504-59c8-4572-9449-f5b4668f739c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:48.046265 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-71cec504-59c8-4572-9449-f5b4668f739c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:48.165591 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-71cec504-59c8-4572-9449-f5b4668f739c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:48.174295 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-71cec504-59c8-4572-9449-f5b4668f739c tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1214 microversion: 2.1 time: 0.140269 Aug 08 16:53:48.175024 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 147/284] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:48 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:48.615201 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0e898c10-913a-42a6-9d89-39ba9ce3199e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:48.636326 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0e898c10-913a-42a6-9d89-39ba9ce3199e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.731664 Aug 08 16:53:48.640323 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 138/285] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:47 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:49.203183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2e264261-7aed-499d-b97b-32b05f9d2753 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:49.204932 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2e264261-7aed-499d-b97b-32b05f9d2753 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:49.211519 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2e264261-7aed-499d-b97b-32b05f9d2753 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:49.212019 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2e264261-7aed-499d-b97b-32b05f9d2753 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:49.212455 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2e264261-7aed-499d-b97b-32b05f9d2753 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:49.213163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2e264261-7aed-499d-b97b-32b05f9d2753 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:49.213623 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2e264261-7aed-499d-b97b-32b05f9d2753 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:49.214041 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2e264261-7aed-499d-b97b-32b05f9d2753 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:49.301533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2e264261-7aed-499d-b97b-32b05f9d2753 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:49.310074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2e264261-7aed-499d-b97b-32b05f9d2753 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1218 microversion: 2.1 time: 0.112660 Aug 08 16:53:49.310979 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 148/286] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:49 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:49.666462 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-aad09dfb-fe4f-4a4a-bc1f-a772f9b82159 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:49.668962 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-aad09dfb-fe4f-4a4a-bc1f-a772f9b82159 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:49.686524 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aad09dfb-fe4f-4a4a-bc1f-a772f9b82159 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:49.687670 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aad09dfb-fe4f-4a4a-bc1f-a772f9b82159 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:49.688228 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aad09dfb-fe4f-4a4a-bc1f-a772f9b82159 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:49.689427 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aad09dfb-fe4f-4a4a-bc1f-a772f9b82159 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:49.690021 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aad09dfb-fe4f-4a4a-bc1f-a772f9b82159 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:49.690797 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aad09dfb-fe4f-4a4a-bc1f-a772f9b82159 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:49.858081 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-aad09dfb-fe4f-4a4a-bc1f-a772f9b82159 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:49.871516 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-aad09dfb-fe4f-4a4a-bc1f-a772f9b82159 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.216052 Aug 08 16:53:49.872562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 139/287] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:49 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:50.333890 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-56ad2aa0-f682-489f-a69c-a582c48f451b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:50.334748 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-56ad2aa0-f682-489f-a69c-a582c48f451b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:50.345474 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56ad2aa0-f682-489f-a69c-a582c48f451b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:50.345474 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56ad2aa0-f682-489f-a69c-a582c48f451b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:50.345474 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56ad2aa0-f682-489f-a69c-a582c48f451b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:50.346201 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56ad2aa0-f682-489f-a69c-a582c48f451b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:50.347747 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56ad2aa0-f682-489f-a69c-a582c48f451b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:50.350399 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56ad2aa0-f682-489f-a69c-a582c48f451b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:50.539646 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-56ad2aa0-f682-489f-a69c-a582c48f451b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:50.549406 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-56ad2aa0-f682-489f-a69c-a582c48f451b tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1218 microversion: 2.1 time: 0.220077 Aug 08 16:53:50.559122 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 149/288] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:50 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1218 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:50.905940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-63d885f4-10fa-4794-a151-b5d62c32d63d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:50.909015 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-63d885f4-10fa-4794-a151-b5d62c32d63d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:50.924349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-63d885f4-10fa-4794-a151-b5d62c32d63d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:50.926137 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-63d885f4-10fa-4794-a151-b5d62c32d63d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:50.927260 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-63d885f4-10fa-4794-a151-b5d62c32d63d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:50.928986 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-63d885f4-10fa-4794-a151-b5d62c32d63d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:50.930014 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-63d885f4-10fa-4794-a151-b5d62c32d63d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:50.930983 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-63d885f4-10fa-4794-a151-b5d62c32d63d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:51.263381 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-63d885f4-10fa-4794-a151-b5d62c32d63d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:51.278054 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-63d885f4-10fa-4794-a151-b5d62c32d63d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.380256 Aug 08 16:53:51.279458 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 140/289] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:50 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:51.583286 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2b8017b3-c0f7-4cc4-955f-282f521a5cc7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:51.585754 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2b8017b3-c0f7-4cc4-955f-282f521a5cc7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:51.592531 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2b8017b3-c0f7-4cc4-955f-282f521a5cc7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:51.593029 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2b8017b3-c0f7-4cc4-955f-282f521a5cc7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:51.593469 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2b8017b3-c0f7-4cc4-955f-282f521a5cc7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:51.594274 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2b8017b3-c0f7-4cc4-955f-282f521a5cc7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:51.594786 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2b8017b3-c0f7-4cc4-955f-282f521a5cc7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:51.595214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2b8017b3-c0f7-4cc4-955f-282f521a5cc7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:51.683821 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2b8017b3-c0f7-4cc4-955f-282f521a5cc7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:51.699062 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2b8017b3-c0f7-4cc4-955f-282f521a5cc7 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1266 microversion: 2.1 time: 0.122080 Aug 08 16:53:51.713074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 150/290] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:51 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:52.312675 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-aaa821de-c186-459b-89c8-f22f7cd067be tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:52.313583 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-aaa821de-c186-459b-89c8-f22f7cd067be tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:52.322336 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaa821de-c186-459b-89c8-f22f7cd067be tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:52.323051 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaa821de-c186-459b-89c8-f22f7cd067be tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:52.323589 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaa821de-c186-459b-89c8-f22f7cd067be tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:52.324798 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaa821de-c186-459b-89c8-f22f7cd067be tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:52.325355 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaa821de-c186-459b-89c8-f22f7cd067be tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:52.325901 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaa821de-c186-459b-89c8-f22f7cd067be tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:52.615478 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-aaa821de-c186-459b-89c8-f22f7cd067be tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:52.635666 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-aaa821de-c186-459b-89c8-f22f7cd067be tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1522 microversion: 2.1 time: 0.327465 Aug 08 16:53:52.636792 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 141/291] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:52 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:52.732480 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-acec6e20-cb82-46ed-aecf-3ecb23d5ade4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:52.733318 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-acec6e20-cb82-46ed-aecf-3ecb23d5ade4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:52.744262 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-acec6e20-cb82-46ed-aecf-3ecb23d5ade4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:52.745552 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-acec6e20-cb82-46ed-aecf-3ecb23d5ade4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:52.746463 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-acec6e20-cb82-46ed-aecf-3ecb23d5ade4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:52.748141 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-acec6e20-cb82-46ed-aecf-3ecb23d5ade4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:52.749542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-acec6e20-cb82-46ed-aecf-3ecb23d5ade4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:52.750444 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-acec6e20-cb82-46ed-aecf-3ecb23d5ade4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:52.874967 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-acec6e20-cb82-46ed-aecf-3ecb23d5ade4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:52.891333 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-acec6e20-cb82-46ed-aecf-3ecb23d5ade4 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1274 microversion: 2.1 time: 0.162966 Aug 08 16:53:52.892444 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 151/292] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:52 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:53.685026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d9d46803-e496-4310-9af6-7156895ff236 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:53.686820 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d9d46803-e496-4310-9af6-7156895ff236 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:53.708869 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9d46803-e496-4310-9af6-7156895ff236 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:53.711379 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9d46803-e496-4310-9af6-7156895ff236 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:53.712174 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9d46803-e496-4310-9af6-7156895ff236 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:53.713447 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9d46803-e496-4310-9af6-7156895ff236 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:53.714238 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9d46803-e496-4310-9af6-7156895ff236 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:53.715026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9d46803-e496-4310-9af6-7156895ff236 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:53.922992 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-db6ec936-492a-49e5-9f55-afa97f83ced3 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:53.924802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-db6ec936-492a-49e5-9f55-afa97f83ced3 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:53.943248 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-db6ec936-492a-49e5-9f55-afa97f83ced3 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:53.946201 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-db6ec936-492a-49e5-9f55-afa97f83ced3 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:53.949229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-db6ec936-492a-49e5-9f55-afa97f83ced3 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:53.950466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-db6ec936-492a-49e5-9f55-afa97f83ced3 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:53.953293 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-db6ec936-492a-49e5-9f55-afa97f83ced3 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:53.953968 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-db6ec936-492a-49e5-9f55-afa97f83ced3 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:54.117823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d9d46803-e496-4310-9af6-7156895ff236 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:54.129319 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d9d46803-e496-4310-9af6-7156895ff236 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1502 microversion: 2.1 time: 0.463609 Aug 08 16:53:54.144603 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 142/293] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:53 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1502 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:54.153429 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6d03d28f-b251-4052-a8e3-b63d25ee35f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:54.154311 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6d03d28f-b251-4052-a8e3-b63d25ee35f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:54.170594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-db6ec936-492a-49e5-9f55-afa97f83ced3 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:54.175452 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6d03d28f-b251-4052-a8e3-b63d25ee35f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:54.175452 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6d03d28f-b251-4052-a8e3-b63d25ee35f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:54.175452 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6d03d28f-b251-4052-a8e3-b63d25ee35f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:54.175452 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6d03d28f-b251-4052-a8e3-b63d25ee35f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:54.175998 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6d03d28f-b251-4052-a8e3-b63d25ee35f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:54.175998 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6d03d28f-b251-4052-a8e3-b63d25ee35f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:54.195516 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-db6ec936-492a-49e5-9f55-afa97f83ced3 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1272 microversion: 2.1 time: 0.277170 Aug 08 16:53:54.214756 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 152/294] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:53 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:54.415212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-6d03d28f-b251-4052-a8e3-b63d25ee35f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:54.429775 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-6d03d28f-b251-4052-a8e3-b63d25ee35f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1517 microversion: 2.1 time: 0.280172 Aug 08 16:53:54.438792 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 143/295] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:54 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1517 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:55.241164 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c378bbeb-efc2-42b9-a6d2-4e40ec601986 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:55.242215 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c378bbeb-efc2-42b9-a6d2-4e40ec601986 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:55.255064 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:55.261534 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c378bbeb-efc2-42b9-a6d2-4e40ec601986 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:55.262407 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c378bbeb-efc2-42b9-a6d2-4e40ec601986 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:55.263245 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c378bbeb-efc2-42b9-a6d2-4e40ec601986 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:55.264504 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c378bbeb-efc2-42b9-a6d2-4e40ec601986 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:55.265307 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c378bbeb-efc2-42b9-a6d2-4e40ec601986 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:55.266306 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c378bbeb-efc2-42b9-a6d2-4e40ec601986 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:55.605424 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c378bbeb-efc2-42b9-a6d2-4e40ec601986 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:55.665758 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c378bbeb-efc2-42b9-a6d2-4e40ec601986 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1314 microversion: 2.1 time: 0.430603 Aug 08 16:53:55.668614 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 153/296] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:55 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:56.706045 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-12dc8dd1-94a5-4414-b76a-e40dd965eaf9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:56.706045 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-12dc8dd1-94a5-4414-b76a-e40dd965eaf9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:56.723720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-12dc8dd1-94a5-4414-b76a-e40dd965eaf9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:56.724942 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-12dc8dd1-94a5-4414-b76a-e40dd965eaf9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:56.727121 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-12dc8dd1-94a5-4414-b76a-e40dd965eaf9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:56.728944 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-12dc8dd1-94a5-4414-b76a-e40dd965eaf9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:56.731142 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-12dc8dd1-94a5-4414-b76a-e40dd965eaf9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:56.731999 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-12dc8dd1-94a5-4414-b76a-e40dd965eaf9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:56.991365 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-12dc8dd1-94a5-4414-b76a-e40dd965eaf9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:57.015542 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-12dc8dd1-94a5-4414-b76a-e40dd965eaf9 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1314 microversion: 2.1 time: 0.322586 Aug 08 16:53:57.017259 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 144/297] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:56 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:53:57.082939 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-1cf48ad8-f8bc-4dcb-81ca-172f191edf6c req-fc0c075d-1bd2-4f53-8760-64776f963e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45555d44-c320-4537-a7ee-bcfee4a85bfe", "tag": "ebd8a852-5060-4745-aa5f-eecf07bcb79f"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:57.101297 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:57.107376 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-1cf48ad8-f8bc-4dcb-81ca-172f191edf6c req-fc0c075d-1bd2-4f53-8760-64776f963e37 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:57.108363 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-1cf48ad8-f8bc-4dcb-81ca-172f191edf6c req-fc0c075d-1bd2-4f53-8760-64776f963e37 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:57.111509 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-1cf48ad8-f8bc-4dcb-81ca-172f191edf6c req-fc0c075d-1bd2-4f53-8760-64776f963e37 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:57.141674 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-1cf48ad8-f8bc-4dcb-81ca-172f191edf6c req-fc0c075d-1bd2-4f53-8760-64776f963e37 service nova] Creating event network-changed:ebd8a852-5060-4745-aa5f-eecf07bcb79f for instance 45555d44-c320-4537-a7ee-bcfee4a85bfe on hv-cinder-85220 Aug 08 16:53:57.154201 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-1cf48ad8-f8bc-4dcb-81ca-172f191edf6c req-fc0c075d-1bd2-4f53-8760-64776f963e37 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075361 Aug 08 16:53:57.159454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 154/298] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:53:57.936960 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1bc79362-9dee-4470-9e6f-689c79e1fd9b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:53:57.939413 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1bc79362-9dee-4470-9e6f-689c79e1fd9b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:57.947153 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1bc79362-9dee-4470-9e6f-689c79e1fd9b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:57.947646 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1bc79362-9dee-4470-9e6f-689c79e1fd9b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:57.948089 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1bc79362-9dee-4470-9e6f-689c79e1fd9b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:57.948813 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1bc79362-9dee-4470-9e6f-689c79e1fd9b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:57.949524 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1bc79362-9dee-4470-9e6f-689c79e1fd9b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:57.950018 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1bc79362-9dee-4470-9e6f-689c79e1fd9b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:57.979405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-1bc79362-9dee-4470-9e6f-689c79e1fd9b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lazy-loading 'flavor' on Instance uuid 65990fbf-4d36-42ed-8f3b-3406d373841a {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:53:58.053924 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-822f03d3-0782-4164-8468-07914257da75 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:58.054784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-822f03d3-0782-4164-8468-07914257da75 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:58.081184 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-822f03d3-0782-4164-8468-07914257da75 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:58.081682 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-822f03d3-0782-4164-8468-07914257da75 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:58.082332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-822f03d3-0782-4164-8468-07914257da75 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:58.083290 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-822f03d3-0782-4164-8468-07914257da75 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:58.084536 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-822f03d3-0782-4164-8468-07914257da75 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:58.085379 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-822f03d3-0782-4164-8468-07914257da75 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:58.171518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=10 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:53:58.423026 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-822f03d3-0782-4164-8468-07914257da75 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:58.444831 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1bc79362-9dee-4470-9e6f-689c79e1fd9b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "POST /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a/action" status: 200 len: 32 microversion: 2.1 time: 0.509290 Aug 08 16:53:58.446026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 145/299] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 16:53:57 2022] POST /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a/action => generated 32 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 16:53:58.455966 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-822f03d3-0782-4164-8468-07914257da75 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1314 microversion: 2.1 time: 0.406518 Aug 08 16:53:58.458631 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 155/300] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:58 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:58.485914 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-adba4154-e60d-41c8-b10d-4cc93aadb84e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:58.493311 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-adba4154-e60d-41c8-b10d-4cc93aadb84e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:58.513051 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-adba4154-e60d-41c8-b10d-4cc93aadb84e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:58.513820 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-adba4154-e60d-41c8-b10d-4cc93aadb84e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:58.514457 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-adba4154-e60d-41c8-b10d-4cc93aadb84e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:58.515397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-adba4154-e60d-41c8-b10d-4cc93aadb84e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:58.516962 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-adba4154-e60d-41c8-b10d-4cc93aadb84e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:58.517863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-adba4154-e60d-41c8-b10d-4cc93aadb84e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:59.077551 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-adba4154-e60d-41c8-b10d-4cc93aadb84e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:59.089928 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-adba4154-e60d-41c8-b10d-4cc93aadb84e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.635291 Aug 08 16:53:59.118593 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 146/301] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:58 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:53:59.488419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-56f8697b-2b73-413b-bfb6-bc6a2dcb1ecf tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:53:59.494319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-56f8697b-2b73-413b-bfb6-bc6a2dcb1ecf tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:53:59.516301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f8697b-2b73-413b-bfb6-bc6a2dcb1ecf tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:59.517941 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f8697b-2b73-413b-bfb6-bc6a2dcb1ecf tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:59.519984 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f8697b-2b73-413b-bfb6-bc6a2dcb1ecf tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:59.528126 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f8697b-2b73-413b-bfb6-bc6a2dcb1ecf tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:53:59.528126 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f8697b-2b73-413b-bfb6-bc6a2dcb1ecf tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:53:59.528126 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f8697b-2b73-413b-bfb6-bc6a2dcb1ecf tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:53:59.750811 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-56f8697b-2b73-413b-bfb6-bc6a2dcb1ecf tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:53:59.762525 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-56f8697b-2b73-413b-bfb6-bc6a2dcb1ecf tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1314 microversion: 2.1 time: 0.282004 Aug 08 16:53:59.763195 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 156/302] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:53:59 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:00.126164 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-695debf2-6b84-4728-9825-26aaeb546997 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:00.130526 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-695debf2-6b84-4728-9825-26aaeb546997 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:00.150330 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-695debf2-6b84-4728-9825-26aaeb546997 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:00.162121 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-695debf2-6b84-4728-9825-26aaeb546997 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:00.169975 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-695debf2-6b84-4728-9825-26aaeb546997 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:00.169975 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-695debf2-6b84-4728-9825-26aaeb546997 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:00.169975 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-695debf2-6b84-4728-9825-26aaeb546997 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:00.169975 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-695debf2-6b84-4728-9825-26aaeb546997 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:00.517420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-695debf2-6b84-4728-9825-26aaeb546997 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:00.532945 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-695debf2-6b84-4728-9825-26aaeb546997 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.419011 Aug 08 16:54:00.553395 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 147/303] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:00 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:00.805229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4f0538e4-269c-4c48-a62f-3259b136666d tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:00.807897 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4f0538e4-269c-4c48-a62f-3259b136666d tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:00.839846 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4f0538e4-269c-4c48-a62f-3259b136666d tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:00.840963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4f0538e4-269c-4c48-a62f-3259b136666d tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:00.841387 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4f0538e4-269c-4c48-a62f-3259b136666d tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:00.842894 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4f0538e4-269c-4c48-a62f-3259b136666d tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:00.850819 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4f0538e4-269c-4c48-a62f-3259b136666d tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:00.850819 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4f0538e4-269c-4c48-a62f-3259b136666d tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:01.472954 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4f0538e4-269c-4c48-a62f-3259b136666d tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:01.500312 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4f0538e4-269c-4c48-a62f-3259b136666d tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1314 microversion: 2.1 time: 0.697505 Aug 08 16:54:01.510927 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 157/304] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:00 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:01.595194 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0780470f-5f46-420f-9b5d-e800a9637054 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:01.596273 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0780470f-5f46-420f-9b5d-e800a9637054 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:01.615954 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0780470f-5f46-420f-9b5d-e800a9637054 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:01.615954 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0780470f-5f46-420f-9b5d-e800a9637054 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:01.615954 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0780470f-5f46-420f-9b5d-e800a9637054 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:01.615954 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0780470f-5f46-420f-9b5d-e800a9637054 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:01.616666 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0780470f-5f46-420f-9b5d-e800a9637054 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:01.617038 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0780470f-5f46-420f-9b5d-e800a9637054 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:02.088913 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0780470f-5f46-420f-9b5d-e800a9637054 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:02.104278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0780470f-5f46-420f-9b5d-e800a9637054 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.515214 Aug 08 16:54:02.120952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 148/305] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:01 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:02.543230 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-66a4c155-4843-459f-b79e-5736d720624a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:02.544889 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-66a4c155-4843-459f-b79e-5736d720624a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:02.562419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-66a4c155-4843-459f-b79e-5736d720624a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:02.563405 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-66a4c155-4843-459f-b79e-5736d720624a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:02.564105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-66a4c155-4843-459f-b79e-5736d720624a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:02.566208 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-66a4c155-4843-459f-b79e-5736d720624a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:02.568188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-66a4c155-4843-459f-b79e-5736d720624a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:02.569198 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-66a4c155-4843-459f-b79e-5736d720624a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:02.880125 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-66a4c155-4843-459f-b79e-5736d720624a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:02.916675 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-66a4c155-4843-459f-b79e-5736d720624a tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1314 microversion: 2.1 time: 0.382923 Aug 08 16:54:02.919824 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 158/306] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:02 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:03.131339 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8cf73e77-c5c1-4699-bd17-0a3424203fed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:03.134179 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8cf73e77-c5c1-4699-bd17-0a3424203fed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:03.155461 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8cf73e77-c5c1-4699-bd17-0a3424203fed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:03.156578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8cf73e77-c5c1-4699-bd17-0a3424203fed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:03.157568 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8cf73e77-c5c1-4699-bd17-0a3424203fed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:03.158974 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8cf73e77-c5c1-4699-bd17-0a3424203fed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:03.161036 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8cf73e77-c5c1-4699-bd17-0a3424203fed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:03.163134 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8cf73e77-c5c1-4699-bd17-0a3424203fed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:03.473799 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-bd87a28c-b236-4618-bc90-9a071ca3f8ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Action: 'create', calling method: .version_select at 0x7f5016270c10>, body: {"keypair": {"name": "tempest-keypair-2008876410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAsZ1y8SOuqP878Su8Pi92zn/dBNvCDERwcIFzpvkVLa6Qd1eqWzWAhEJntj4e167RSTtog8juwVy9jPMxMXFUYSyZ8C1QbJECDN2M+dpIT8N2vkMuROggQ91CwOInPIQ=="}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:03.492560 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:03.494162 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8cf73e77-c5c1-4699-bd17-0a3424203fed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:03.512642 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-8cf73e77-c5c1-4699-bd17-0a3424203fed tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.388988 Aug 08 16:54:03.513847 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 159/307] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:03 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:03.523184 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-bd87a28c-b236-4618-bc90-9a071ca3f8ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Getting quotas for project fa4be8df3fe34d71a3c3d91995c1edae. Resources: {'key_pairs'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:54:03.531126 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-bd87a28c-b236-4618-bc90-9a071ca3f8ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Getting quotas for user d6d78cbc233a498db3a9268a4b93d737 and project fa4be8df3fe34d71a3c3d91995c1edae. Resources: {'key_pairs'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:54:03.638050 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-bd87a28c-b236-4618-bc90-9a071ca3f8ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.692437 Aug 08 16:54:03.640306 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 149/308] 10.222.0.13 () {62 vars in 1200 bytes} [Mon Aug 8 16:54:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 708 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 16:54:03.959933 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a0498ebc-5520-49b3-8ddb-5f836d0d1e06 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:03.961410 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a0498ebc-5520-49b3-8ddb-5f836d0d1e06 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:03.970397 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a0498ebc-5520-49b3-8ddb-5f836d0d1e06 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:03.971655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a0498ebc-5520-49b3-8ddb-5f836d0d1e06 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:03.972412 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a0498ebc-5520-49b3-8ddb-5f836d0d1e06 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:03.974267 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a0498ebc-5520-49b3-8ddb-5f836d0d1e06 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:03.975407 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a0498ebc-5520-49b3-8ddb-5f836d0d1e06 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:03.976405 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a0498ebc-5520-49b3-8ddb-5f836d0d1e06 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:04.184941 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a0498ebc-5520-49b3-8ddb-5f836d0d1e06 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:04.193916 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a0498ebc-5520-49b3-8ddb-5f836d0d1e06 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1314 microversion: 2.1 time: 0.239481 Aug 08 16:54:04.194870 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 160/309] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:03 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:04.538954 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-07fde021-e9b6-47b0-bbfc-9208b75b2a78 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:04.540293 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-07fde021-e9b6-47b0-bbfc-9208b75b2a78 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:04.564431 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07fde021-e9b6-47b0-bbfc-9208b75b2a78 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:04.564946 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07fde021-e9b6-47b0-bbfc-9208b75b2a78 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:04.568652 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07fde021-e9b6-47b0-bbfc-9208b75b2a78 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:04.568652 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07fde021-e9b6-47b0-bbfc-9208b75b2a78 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:04.568652 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07fde021-e9b6-47b0-bbfc-9208b75b2a78 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:04.568652 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07fde021-e9b6-47b0-bbfc-9208b75b2a78 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:04.842506 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-07fde021-e9b6-47b0-bbfc-9208b75b2a78 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:04.856438 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:04.864432 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-07fde021-e9b6-47b0-bbfc-9208b75b2a78 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.330380 Aug 08 16:54:04.865503 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 150/310] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:04 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:05.215488 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-59ef679a-9ce1-4da9-8ecf-dce93caf05a8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:05.216208 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-59ef679a-9ce1-4da9-8ecf-dce93caf05a8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:05.223770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-59ef679a-9ce1-4da9-8ecf-dce93caf05a8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:05.224269 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-59ef679a-9ce1-4da9-8ecf-dce93caf05a8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:05.224810 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-59ef679a-9ce1-4da9-8ecf-dce93caf05a8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:05.225552 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-59ef679a-9ce1-4da9-8ecf-dce93caf05a8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:05.226017 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-59ef679a-9ce1-4da9-8ecf-dce93caf05a8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:05.226720 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-59ef679a-9ce1-4da9-8ecf-dce93caf05a8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:05.428067 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-59ef679a-9ce1-4da9-8ecf-dce93caf05a8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:05.432371 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=100 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:05.441256 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-59ef679a-9ce1-4da9-8ecf-dce93caf05a8 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1314 microversion: 2.1 time: 0.229365 Aug 08 16:54:05.443056 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 161/311] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:05 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:05.903543 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-83ecd812-f83e-43eb-aa54-730961efaaa3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:05.909648 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-83ecd812-f83e-43eb-aa54-730961efaaa3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:05.946070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-83ecd812-f83e-43eb-aa54-730961efaaa3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:05.951986 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-83ecd812-f83e-43eb-aa54-730961efaaa3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:05.953267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-83ecd812-f83e-43eb-aa54-730961efaaa3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:05.957193 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-83ecd812-f83e-43eb-aa54-730961efaaa3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:05.958847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-83ecd812-f83e-43eb-aa54-730961efaaa3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:05.963236 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-83ecd812-f83e-43eb-aa54-730961efaaa3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:06.013021 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-96c2d637-564b-451e-949b-df4d31471071 req-ea6cd95d-de33-4804-b25a-797773b924e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45555d44-c320-4537-a7ee-bcfee4a85bfe", "name": "network-vif-plugged", "status": "completed", "tag": "ebd8a852-5060-4745-aa5f-eecf07bcb79f"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:06.098659 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-96c2d637-564b-451e-949b-df4d31471071 req-ea6cd95d-de33-4804-b25a-797773b924e6 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:06.111892 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-96c2d637-564b-451e-949b-df4d31471071 req-ea6cd95d-de33-4804-b25a-797773b924e6 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:06.113729 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-96c2d637-564b-451e-949b-df4d31471071 req-ea6cd95d-de33-4804-b25a-797773b924e6 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:06.165480 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-96c2d637-564b-451e-949b-df4d31471071 req-ea6cd95d-de33-4804-b25a-797773b924e6 service nova] Creating event network-vif-plugged:ebd8a852-5060-4745-aa5f-eecf07bcb79f for instance 45555d44-c320-4537-a7ee-bcfee4a85bfe on hv-cinder-85220 Aug 08 16:54:06.182357 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-96c2d637-564b-451e-949b-df4d31471071 req-ea6cd95d-de33-4804-b25a-797773b924e6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176532 Aug 08 16:54:06.183588 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 162/312] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:54:06.358811 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-83ecd812-f83e-43eb-aa54-730961efaaa3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:06.423115 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-83ecd812-f83e-43eb-aa54-730961efaaa3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.532252 Aug 08 16:54:06.440016 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 151/313] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:05 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:06.487562 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-50c308be-9c8e-4143-8316-1aab68276db2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:06.489840 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-50c308be-9c8e-4143-8316-1aab68276db2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:06.522474 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-50c308be-9c8e-4143-8316-1aab68276db2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:06.525387 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-50c308be-9c8e-4143-8316-1aab68276db2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:06.526664 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-50c308be-9c8e-4143-8316-1aab68276db2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:06.529316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-50c308be-9c8e-4143-8316-1aab68276db2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:06.534839 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-50c308be-9c8e-4143-8316-1aab68276db2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:06.534839 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-50c308be-9c8e-4143-8316-1aab68276db2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:06.820415 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-50c308be-9c8e-4143-8316-1aab68276db2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:06.835416 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-50c308be-9c8e-4143-8316-1aab68276db2 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1314 microversion: 2.1 time: 0.357124 Aug 08 16:54:06.837322 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 163/314] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:06 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:07.466506 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-772a12d5-d7d1-4b4d-8f62-2766f8f9b760 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:07.467264 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-772a12d5-d7d1-4b4d-8f62-2766f8f9b760 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:07.476350 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-772a12d5-d7d1-4b4d-8f62-2766f8f9b760 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:07.476962 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-772a12d5-d7d1-4b4d-8f62-2766f8f9b760 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:07.477488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-772a12d5-d7d1-4b4d-8f62-2766f8f9b760 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:07.478361 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-772a12d5-d7d1-4b4d-8f62-2766f8f9b760 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:07.478859 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-772a12d5-d7d1-4b4d-8f62-2766f8f9b760 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:07.479291 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-772a12d5-d7d1-4b4d-8f62-2766f8f9b760 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:07.696879 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1708279247", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c74914b0-0404-42f3-ba1f-a87c87df5430"}], "security_groups": [{"name": "tempest-securitygroup--231564464"}], "key_name": "tempest-keypair-2008876410", "user_data": "}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:07.741482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-772a12d5-d7d1-4b4d-8f62-2766f8f9b760 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:07.752020 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-772a12d5-d7d1-4b4d-8f62-2766f8f9b760 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.290181 Aug 08 16:54:07.754540 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 152/315] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:07 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:07.861567 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c0d94ee1-7001-46cd-a192-7dbb6c0a2a82 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:07.863217 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c0d94ee1-7001-46cd-a192-7dbb6c0a2a82 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:07.874382 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0d94ee1-7001-46cd-a192-7dbb6c0a2a82 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:07.876704 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0d94ee1-7001-46cd-a192-7dbb6c0a2a82 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:07.877454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0d94ee1-7001-46cd-a192-7dbb6c0a2a82 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:07.878470 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0d94ee1-7001-46cd-a192-7dbb6c0a2a82 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:07.880089 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0d94ee1-7001-46cd-a192-7dbb6c0a2a82 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:07.880350 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.network.neutron [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] validate_networks() for [('c74914b0-0404-42f3-ba1f-a87c87df5430', None, None, None, None, None)] {{(pid=130236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:54:07.880848 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0d94ee1-7001-46cd-a192-7dbb6c0a2a82 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:08.140586 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c0d94ee1-7001-46cd-a192-7dbb6c0a2a82 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:08.160336 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c0d94ee1-7001-46cd-a192-7dbb6c0a2a82 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1314 microversion: 2.1 time: 0.306042 Aug 08 16:54:08.161156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 153/316] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:07 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:08.541536 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Flavor limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:54:08.542080 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Image limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:54:08.542742 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Flavor pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:54:08.543361 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Image pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:54:08.543906 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:54:08.556718 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:08.558597 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:08.558597 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:08.559143 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:08.559716 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:08.560439 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:08.583042 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Getting quotas for project fa4be8df3fe34d71a3c3d91995c1edae. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:54:08.588511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Getting quotas for user d6d78cbc233a498db3a9268a4b93d737 and project fa4be8df3fe34d71a3c3d91995c1edae. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:54:08.603081 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Going to run 1 instances... {{(pid=130236) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:54:08.605866 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:54:08.745662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f4cbc43f-371d-4cf5-a874-1106d444177c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.053527 Aug 08 16:54:08.747014 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 164/317] 10.222.0.13 () {62 vars in 1188 bytes} [Mon Aug 8 16:54:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 08 16:54:08.762031 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0e326214-fadd-4582-af68-0bdec30dda15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:08.762908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0e326214-fadd-4582-af68-0bdec30dda15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:08.794946 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-521398f4-f2c5-4d07-bc25-b5fd6d457367 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:08.797776 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-521398f4-f2c5-4d07-bc25-b5fd6d457367 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:08.806519 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-521398f4-f2c5-4d07-bc25-b5fd6d457367 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:08.812077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-521398f4-f2c5-4d07-bc25-b5fd6d457367 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:08.812077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-521398f4-f2c5-4d07-bc25-b5fd6d457367 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:08.812077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-521398f4-f2c5-4d07-bc25-b5fd6d457367 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:08.812077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-521398f4-f2c5-4d07-bc25-b5fd6d457367 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:08.812418 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-521398f4-f2c5-4d07-bc25-b5fd6d457367 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:08.864413 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0e326214-fadd-4582-af68-0bdec30dda15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:08.878218 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0e326214-fadd-4582-af68-0bdec30dda15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:08.882403 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0e326214-fadd-4582-af68-0bdec30dda15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:08.892800 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0e326214-fadd-4582-af68-0bdec30dda15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1282 microversion: 2.20 time: 0.127498 Aug 08 16:54:08.892800 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 154/318] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:08 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1282 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:54:09.108555 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-521398f4-f2c5-4d07-bc25-b5fd6d457367 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:09.119014 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-521398f4-f2c5-4d07-bc25-b5fd6d457367 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.336012 Aug 08 16:54:09.119843 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 165/319] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:08 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:09.187541 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a907f932-e383-45e6-822b-a95506cf8a02 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:09.188239 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a907f932-e383-45e6-822b-a95506cf8a02 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:09.197114 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a907f932-e383-45e6-822b-a95506cf8a02 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:09.197616 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a907f932-e383-45e6-822b-a95506cf8a02 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:09.198181 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a907f932-e383-45e6-822b-a95506cf8a02 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:09.199113 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a907f932-e383-45e6-822b-a95506cf8a02 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:09.199633 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a907f932-e383-45e6-822b-a95506cf8a02 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:09.200064 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a907f932-e383-45e6-822b-a95506cf8a02 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:09.388475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a907f932-e383-45e6-822b-a95506cf8a02 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:09.403661 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a907f932-e383-45e6-822b-a95506cf8a02 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1314 microversion: 2.1 time: 0.220065 Aug 08 16:54:09.405782 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 155/320] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:09 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:09.930084 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-bc832dce-f243-4a1a-9c3d-792e9fb34a8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:09.933422 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-bc832dce-f243-4a1a-9c3d-792e9fb34a8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:10.061535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bc832dce-f243-4a1a-9c3d-792e9fb34a8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:10.071989 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bc832dce-f243-4a1a-9c3d-792e9fb34a8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:10.075230 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bc832dce-f243-4a1a-9c3d-792e9fb34a8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:10.078200 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-bc832dce-f243-4a1a-9c3d-792e9fb34a8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1282 microversion: 2.20 time: 0.158643 Aug 08 16:54:10.079182 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 166/321] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:09 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:54:10.150290 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-49800779-6c9e-429b-9583-5eaf2d65c8b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:10.151430 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-49800779-6c9e-429b-9583-5eaf2d65c8b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:10.164713 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-49800779-6c9e-429b-9583-5eaf2d65c8b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:10.165550 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-49800779-6c9e-429b-9583-5eaf2d65c8b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:10.166340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-49800779-6c9e-429b-9583-5eaf2d65c8b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:10.167682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-49800779-6c9e-429b-9583-5eaf2d65c8b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:10.168494 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-49800779-6c9e-429b-9583-5eaf2d65c8b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:10.169250 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-49800779-6c9e-429b-9583-5eaf2d65c8b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:10.440897 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9792469b-d09a-46ea-a334-d90b2bd83364 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:10.442003 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9792469b-d09a-46ea-a334-d90b2bd83364 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:10.452692 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9792469b-d09a-46ea-a334-d90b2bd83364 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:10.453581 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9792469b-d09a-46ea-a334-d90b2bd83364 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:10.454336 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9792469b-d09a-46ea-a334-d90b2bd83364 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:10.456482 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9792469b-d09a-46ea-a334-d90b2bd83364 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:10.457798 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9792469b-d09a-46ea-a334-d90b2bd83364 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:10.458885 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9792469b-d09a-46ea-a334-d90b2bd83364 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:10.525044 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-49800779-6c9e-429b-9583-5eaf2d65c8b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:10.537329 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-49800779-6c9e-429b-9583-5eaf2d65c8b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.393113 Aug 08 16:54:10.541337 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 156/322] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:10 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:10.663292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9792469b-d09a-46ea-a334-d90b2bd83364 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:10.671754 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9792469b-d09a-46ea-a334-d90b2bd83364 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1314 microversion: 2.1 time: 0.239397 Aug 08 16:54:10.672340 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 167/323] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:10 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:11.117316 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4be255d4-fc8c-4b1d-9f26-af6b5b5aa7bd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:11.118213 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4be255d4-fc8c-4b1d-9f26-af6b5b5aa7bd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:11.125444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4be255d4-fc8c-4b1d-9f26-af6b5b5aa7bd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:11.125990 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4be255d4-fc8c-4b1d-9f26-af6b5b5aa7bd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:11.126470 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4be255d4-fc8c-4b1d-9f26-af6b5b5aa7bd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:11.128824 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4be255d4-fc8c-4b1d-9f26-af6b5b5aa7bd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:11.128824 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4be255d4-fc8c-4b1d-9f26-af6b5b5aa7bd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:11.129367 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4be255d4-fc8c-4b1d-9f26-af6b5b5aa7bd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:11.228562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4be255d4-fc8c-4b1d-9f26-af6b5b5aa7bd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:11.238899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4be255d4-fc8c-4b1d-9f26-af6b5b5aa7bd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:11.240455 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4be255d4-fc8c-4b1d-9f26-af6b5b5aa7bd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:11.241764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4be255d4-fc8c-4b1d-9f26-af6b5b5aa7bd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1286 microversion: 2.20 time: 0.129708 Aug 08 16:54:11.242520 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 157/324] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:11 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:54:11.562338 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f830d40d-e5df-4d71-b444-0e32025b8e25 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:11.567432 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f830d40d-e5df-4d71-b444-0e32025b8e25 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:11.570031 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f830d40d-e5df-4d71-b444-0e32025b8e25 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:11.570534 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f830d40d-e5df-4d71-b444-0e32025b8e25 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:11.571014 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f830d40d-e5df-4d71-b444-0e32025b8e25 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:11.571757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f830d40d-e5df-4d71-b444-0e32025b8e25 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:11.572224 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f830d40d-e5df-4d71-b444-0e32025b8e25 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:11.572654 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f830d40d-e5df-4d71-b444-0e32025b8e25 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:11.703217 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2a0c2996-993c-41b7-9df7-32a1c641e497 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:11.707409 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2a0c2996-993c-41b7-9df7-32a1c641e497 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:11.727250 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a0c2996-993c-41b7-9df7-32a1c641e497 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:11.727250 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a0c2996-993c-41b7-9df7-32a1c641e497 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:11.727250 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a0c2996-993c-41b7-9df7-32a1c641e497 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:11.727250 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a0c2996-993c-41b7-9df7-32a1c641e497 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:11.727807 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a0c2996-993c-41b7-9df7-32a1c641e497 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:11.727807 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a0c2996-993c-41b7-9df7-32a1c641e497 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:11.834545 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f830d40d-e5df-4d71-b444-0e32025b8e25 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:11.844266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f830d40d-e5df-4d71-b444-0e32025b8e25 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.286702 Aug 08 16:54:11.845231 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 168/325] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:11 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:12.211234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2a0c2996-993c-41b7-9df7-32a1c641e497 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:12.218315 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2a0c2996-993c-41b7-9df7-32a1c641e497 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1314 microversion: 2.1 time: 0.519836 Aug 08 16:54:12.219323 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 158/326] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:11 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:12.265970 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-221559d8-0b05-4630-9ce4-6a6d4dee60d3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:12.266641 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-221559d8-0b05-4630-9ce4-6a6d4dee60d3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:12.274341 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-221559d8-0b05-4630-9ce4-6a6d4dee60d3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:12.274341 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-221559d8-0b05-4630-9ce4-6a6d4dee60d3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:12.274692 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-221559d8-0b05-4630-9ce4-6a6d4dee60d3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:12.275357 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-221559d8-0b05-4630-9ce4-6a6d4dee60d3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:12.275817 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-221559d8-0b05-4630-9ce4-6a6d4dee60d3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:12.276283 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-221559d8-0b05-4630-9ce4-6a6d4dee60d3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:12.375282 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-221559d8-0b05-4630-9ce4-6a6d4dee60d3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:12.386349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-221559d8-0b05-4630-9ce4-6a6d4dee60d3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:12.387979 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-221559d8-0b05-4630-9ce4-6a6d4dee60d3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:12.389183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-221559d8-0b05-4630-9ce4-6a6d4dee60d3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1334 microversion: 2.20 time: 0.127685 Aug 08 16:54:12.389756 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 169/327] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:12 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1334 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:54:12.872163 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-141f2bff-31d9-4c54-8b8a-a5a718b3686d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:12.873453 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-141f2bff-31d9-4c54-8b8a-a5a718b3686d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:12.884641 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-141f2bff-31d9-4c54-8b8a-a5a718b3686d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:12.885524 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-141f2bff-31d9-4c54-8b8a-a5a718b3686d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:12.886333 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-141f2bff-31d9-4c54-8b8a-a5a718b3686d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:12.887721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-141f2bff-31d9-4c54-8b8a-a5a718b3686d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:12.888559 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-141f2bff-31d9-4c54-8b8a-a5a718b3686d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:12.889316 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-141f2bff-31d9-4c54-8b8a-a5a718b3686d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:13.045427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1524706667", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "networks": [{"uuid": "8c35df72-56dc-4455-b640-f40dccc55f96"}]}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:13.103037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-141f2bff-31d9-4c54-8b8a-a5a718b3686d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:13.104510 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.network.neutron [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] validate_networks() for [('8c35df72-56dc-4455-b640-f40dccc55f96', None, None, None, None, None)] {{(pid=130236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:54:13.111537 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-141f2bff-31d9-4c54-8b8a-a5a718b3686d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.246990 Aug 08 16:54:13.115359 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 159/328] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:12 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:13.243500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9bee02a0-dbae-41f8-9215-d233eaffa5b6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:13.244127 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9bee02a0-dbae-41f8-9215-d233eaffa5b6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:13.252072 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9bee02a0-dbae-41f8-9215-d233eaffa5b6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:13.253029 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9bee02a0-dbae-41f8-9215-d233eaffa5b6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:13.253732 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9bee02a0-dbae-41f8-9215-d233eaffa5b6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:13.254861 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9bee02a0-dbae-41f8-9215-d233eaffa5b6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:13.255621 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9bee02a0-dbae-41f8-9215-d233eaffa5b6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:13.256080 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9bee02a0-dbae-41f8-9215-d233eaffa5b6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:13.417950 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9bee02a0-dbae-41f8-9215-d233eaffa5b6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:13.433045 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9bee02a0-dbae-41f8-9215-d233eaffa5b6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1499 microversion: 2.1 time: 0.193402 Aug 08 16:54:13.450621 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 160/329] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:13 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1499 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:13.450621 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a2a20323-18ee-4ba4-9def-9801dbf97259 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:13.450621 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a2a20323-18ee-4ba4-9def-9801dbf97259 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:13.450621 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a2a20323-18ee-4ba4-9def-9801dbf97259 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:13.452327 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a2a20323-18ee-4ba4-9def-9801dbf97259 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:13.452327 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a2a20323-18ee-4ba4-9def-9801dbf97259 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:13.452327 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a2a20323-18ee-4ba4-9def-9801dbf97259 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:13.452327 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a2a20323-18ee-4ba4-9def-9801dbf97259 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:13.452888 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a2a20323-18ee-4ba4-9def-9801dbf97259 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:13.529365 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a2a20323-18ee-4ba4-9def-9801dbf97259 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:13.536639 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a2a20323-18ee-4ba4-9def-9801dbf97259 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:13.538258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a2a20323-18ee-4ba4-9def-9801dbf97259 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:13.539663 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a2a20323-18ee-4ba4-9def-9801dbf97259 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1334 microversion: 2.20 time: 0.104517 Aug 08 16:54:13.540214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 161/330] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:13 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1334 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:13.653949 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Flavor limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:54:13.654394 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Image limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:54:13.655142 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Flavor pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:54:13.655673 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Image pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:54:13.656112 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:54:13.667243 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:13.667730 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:13.668180 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:13.668880 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:13.669328 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:13.669749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:13.688469 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Getting quotas for project 49844b73a63b4c338fc5109f70ba774e. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:54:13.694046 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Getting quotas for user 683bed0160e54791a8e638523ac7e460 and project 49844b73a63b4c338fc5109f70ba774e. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:54:13.708868 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Going to run 1 instances... {{(pid=130236) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:54:13.711421 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:54:13.852625 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7e79b2b5-f0e5-491e-ab31-cd25a21a0c29 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811966 Aug 08 16:54:13.858638 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 170/331] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:54:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 16:54:13.872934 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-54121b70-96e1-4f86-8ef9-6226e6a52946 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:13.872934 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-54121b70-96e1-4f86-8ef9-6226e6a52946 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:13.973080 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-54121b70-96e1-4f86-8ef9-6226e6a52946 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:14.008588 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-54121b70-96e1-4f86-8ef9-6226e6a52946 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1219 microversion: 2.1 time: 0.140362 Aug 08 16:54:14.008588 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 162/332] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:13 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:14.145779 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f549aa8b-42f5-4870-b91e-3d54dae43e5a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:14.147204 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f549aa8b-42f5-4870-b91e-3d54dae43e5a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:14.156353 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f549aa8b-42f5-4870-b91e-3d54dae43e5a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:14.157255 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f549aa8b-42f5-4870-b91e-3d54dae43e5a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:14.157907 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f549aa8b-42f5-4870-b91e-3d54dae43e5a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:14.160064 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f549aa8b-42f5-4870-b91e-3d54dae43e5a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:14.164327 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f549aa8b-42f5-4870-b91e-3d54dae43e5a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:14.164327 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f549aa8b-42f5-4870-b91e-3d54dae43e5a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:14.495198 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f549aa8b-42f5-4870-b91e-3d54dae43e5a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:14.514859 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f549aa8b-42f5-4870-b91e-3d54dae43e5a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.374145 Aug 08 16:54:14.532288 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 171/333] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:14 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:14.565373 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-729c42aa-0617-416d-811c-0902df37ebfb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:14.566418 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-729c42aa-0617-416d-811c-0902df37ebfb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:14.580643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-729c42aa-0617-416d-811c-0902df37ebfb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:14.581556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-729c42aa-0617-416d-811c-0902df37ebfb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:14.582209 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-729c42aa-0617-416d-811c-0902df37ebfb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:14.583229 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-729c42aa-0617-416d-811c-0902df37ebfb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:14.583922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-729c42aa-0617-416d-811c-0902df37ebfb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:14.584461 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-729c42aa-0617-416d-811c-0902df37ebfb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:14.683631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-729c42aa-0617-416d-811c-0902df37ebfb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:14.701253 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-729c42aa-0617-416d-811c-0902df37ebfb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:14.706826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-729c42aa-0617-416d-811c-0902df37ebfb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:14.708897 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-729c42aa-0617-416d-811c-0902df37ebfb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1342 microversion: 2.20 time: 0.150007 Aug 08 16:54:14.710059 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 163/334] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:14 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1342 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:14.873313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-935a5b94-d802-4618-9798-a4ed98c412fb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:14.874420 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-935a5b94-d802-4618-9798-a4ed98c412fb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:14.886088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-935a5b94-d802-4618-9798-a4ed98c412fb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:14.887522 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-935a5b94-d802-4618-9798-a4ed98c412fb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:14.889588 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-935a5b94-d802-4618-9798-a4ed98c412fb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:14.891277 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-935a5b94-d802-4618-9798-a4ed98c412fb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:14.892359 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-935a5b94-d802-4618-9798-a4ed98c412fb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:14.894068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-935a5b94-d802-4618-9798-a4ed98c412fb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:14.944960 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-935a5b94-d802-4618-9798-a4ed98c412fb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:54:15.046672 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-73d9e8c5-895f-4591-afd5-df8aa70da696 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:15.047559 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-73d9e8c5-895f-4591-afd5-df8aa70da696 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:15.141648 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-73d9e8c5-895f-4591-afd5-df8aa70da696 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:15.149646 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-73d9e8c5-895f-4591-afd5-df8aa70da696 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1219 microversion: 2.1 time: 0.107250 Aug 08 16:54:15.153862 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 164/335] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:15 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:15.520882 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-935a5b94-d802-4618-9798-a4ed98c412fb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "DELETE /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 204 len: 0 microversion: 2.1 time: 0.654413 Aug 08 16:54:15.521940 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 172/336] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:54:14 2022] DELETE /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 16:54:15.536424 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9e57536b-63a6-4a4a-9938-cfc20f73a3a6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:15.536424 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9e57536b-63a6-4a4a-9938-cfc20f73a3a6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:15.540219 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9e57536b-63a6-4a4a-9938-cfc20f73a3a6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:15.540992 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9e57536b-63a6-4a4a-9938-cfc20f73a3a6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:15.541549 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9e57536b-63a6-4a4a-9938-cfc20f73a3a6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:15.542395 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9e57536b-63a6-4a4a-9938-cfc20f73a3a6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:15.543001 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9e57536b-63a6-4a4a-9938-cfc20f73a3a6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:15.543540 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9e57536b-63a6-4a4a-9938-cfc20f73a3a6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:15.551892 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8da64624-4840-47f1-a415-94de66cd8457 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:15.553272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8da64624-4840-47f1-a415-94de66cd8457 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:15.569781 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8da64624-4840-47f1-a415-94de66cd8457 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:15.571582 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8da64624-4840-47f1-a415-94de66cd8457 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:15.573041 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8da64624-4840-47f1-a415-94de66cd8457 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:15.577250 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8da64624-4840-47f1-a415-94de66cd8457 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:15.578424 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8da64624-4840-47f1-a415-94de66cd8457 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:15.579375 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8da64624-4840-47f1-a415-94de66cd8457 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:15.748580 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9e57536b-63a6-4a4a-9938-cfc20f73a3a6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:15.761402 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9e57536b-63a6-4a4a-9938-cfc20f73a3a6 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1505 microversion: 2.1 time: 0.233942 Aug 08 16:54:15.762693 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 165/337] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:15 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:15.770614 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3f26ccc1-90c2-4310-8df7-0862c841dcce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:15.774065 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-3f26ccc1-90c2-4310-8df7-0862c841dcce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:15.798131 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3f26ccc1-90c2-4310-8df7-0862c841dcce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:15.798810 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3f26ccc1-90c2-4310-8df7-0862c841dcce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:15.800364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3f26ccc1-90c2-4310-8df7-0862c841dcce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:15.801282 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3f26ccc1-90c2-4310-8df7-0862c841dcce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:15.801856 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3f26ccc1-90c2-4310-8df7-0862c841dcce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:15.802755 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3f26ccc1-90c2-4310-8df7-0862c841dcce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:15.844019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-3f26ccc1-90c2-4310-8df7-0862c841dcce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/ips" status: 200 len: 146 microversion: 2.1 time: 0.074152 Aug 08 16:54:15.844019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 166/338] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Aug 8 16:54:15 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/ips => generated 146 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:54:15.849314 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-162c7710-ca3a-48fd-b0b1-9dcccceb4f18 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:15.849872 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-162c7710-ca3a-48fd-b0b1-9dcccceb4f18 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:15.856720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-162c7710-ca3a-48fd-b0b1-9dcccceb4f18 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:15.857624 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-162c7710-ca3a-48fd-b0b1-9dcccceb4f18 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:15.858304 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-162c7710-ca3a-48fd-b0b1-9dcccceb4f18 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:15.859669 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-162c7710-ca3a-48fd-b0b1-9dcccceb4f18 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:15.860540 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-162c7710-ca3a-48fd-b0b1-9dcccceb4f18 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:15.861249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-162c7710-ca3a-48fd-b0b1-9dcccceb4f18 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:15.985806 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-162c7710-ca3a-48fd-b0b1-9dcccceb4f18 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:15.995639 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-162c7710-ca3a-48fd-b0b1-9dcccceb4f18 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:15.997667 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-162c7710-ca3a-48fd-b0b1-9dcccceb4f18 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:15.998959 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-162c7710-ca3a-48fd-b0b1-9dcccceb4f18 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1340 microversion: 2.20 time: 0.154438 Aug 08 16:54:16.007296 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 167/339] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:15 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1340 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:16.020831 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d9601db8-167e-4bc9-88b7-bf3ebcb1e995 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:16.029566 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d9601db8-167e-4bc9-88b7-bf3ebcb1e995 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:16.033594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9601db8-167e-4bc9-88b7-bf3ebcb1e995 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:16.034331 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9601db8-167e-4bc9-88b7-bf3ebcb1e995 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:16.035105 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9601db8-167e-4bc9-88b7-bf3ebcb1e995 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:16.036306 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9601db8-167e-4bc9-88b7-bf3ebcb1e995 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:16.037265 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9601db8-167e-4bc9-88b7-bf3ebcb1e995 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:16.037965 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9601db8-167e-4bc9-88b7-bf3ebcb1e995 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:16.075158 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8da64624-4840-47f1-a415-94de66cd8457 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:16.092221 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d9601db8-167e-4bc9-88b7-bf3ebcb1e995 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/ips" status: 200 len: 148 microversion: 2.1 time: 0.082789 Aug 08 16:54:16.093249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 168/340] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Aug 8 16:54:16 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/ips => generated 148 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:54:16.097601 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-8da64624-4840-47f1-a415-94de66cd8457 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.547656 Aug 08 16:54:16.098904 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 173/341] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:15 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:16.200310 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-cb33df14-ded7-4cf5-93fd-2286a2c9d489 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:16.204203 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-cb33df14-ded7-4cf5-93fd-2286a2c9d489 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:16.217821 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cb33df14-ded7-4cf5-93fd-2286a2c9d489 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:16.219382 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cb33df14-ded7-4cf5-93fd-2286a2c9d489 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:16.220308 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cb33df14-ded7-4cf5-93fd-2286a2c9d489 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:16.221747 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cb33df14-ded7-4cf5-93fd-2286a2c9d489 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:16.223449 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cb33df14-ded7-4cf5-93fd-2286a2c9d489 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:16.224378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cb33df14-ded7-4cf5-93fd-2286a2c9d489 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:16.379465 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-cb33df14-ded7-4cf5-93fd-2286a2c9d489 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:16.404983 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-cb33df14-ded7-4cf5-93fd-2286a2c9d489 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1223 microversion: 2.1 time: 0.212382 Aug 08 16:54:16.406613 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 169/342] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:16 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1223 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:16.805067 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8b8a3bdb-d430-404a-8f32-26a0282f8a30 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:16.808197 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8b8a3bdb-d430-404a-8f32-26a0282f8a30 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:16.844738 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8b8a3bdb-d430-404a-8f32-26a0282f8a30 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:16.847834 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8b8a3bdb-d430-404a-8f32-26a0282f8a30 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:16.856374 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8b8a3bdb-d430-404a-8f32-26a0282f8a30 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:16.858265 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8b8a3bdb-d430-404a-8f32-26a0282f8a30 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:16.859719 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8b8a3bdb-d430-404a-8f32-26a0282f8a30 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:16.860802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8b8a3bdb-d430-404a-8f32-26a0282f8a30 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:17.045531 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-cd7d4685-37be-4e99-bcff-bfd0065befa8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:17.047402 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-cd7d4685-37be-4e99-bcff-bfd0065befa8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:17.089197 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8b8a3bdb-d430-404a-8f32-26a0282f8a30 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:17.099375 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-8b8a3bdb-d430-404a-8f32-26a0282f8a30 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1505 microversion: 2.1 time: 0.303249 Aug 08 16:54:17.099878 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 174/343] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:16 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:17.136353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cd7d4685-37be-4e99-bcff-bfd0065befa8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:17.137188 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cd7d4685-37be-4e99-bcff-bfd0065befa8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:17.137534 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9c6d89e5-7b3a-414a-b103-6d8e618a78d9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:17.138236 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9c6d89e5-7b3a-414a-b103-6d8e618a78d9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:17.145432 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cd7d4685-37be-4e99-bcff-bfd0065befa8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:17.146839 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9c6d89e5-7b3a-414a-b103-6d8e618a78d9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:17.147382 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9c6d89e5-7b3a-414a-b103-6d8e618a78d9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:17.148274 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9c6d89e5-7b3a-414a-b103-6d8e618a78d9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:17.149477 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cd7d4685-37be-4e99-bcff-bfd0065befa8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:17.149850 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9c6d89e5-7b3a-414a-b103-6d8e618a78d9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:17.150505 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9c6d89e5-7b3a-414a-b103-6d8e618a78d9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:17.151175 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9c6d89e5-7b3a-414a-b103-6d8e618a78d9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:17.155218 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cd7d4685-37be-4e99-bcff-bfd0065befa8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:17.162345 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cd7d4685-37be-4e99-bcff-bfd0065befa8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:17.384091 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9c6d89e5-7b3a-414a-b103-6d8e618a78d9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:17.415213 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9c6d89e5-7b3a-414a-b103-6d8e618a78d9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.274890 Aug 08 16:54:17.415213 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 175/344] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:17 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:17.432391 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5bba38a5-fb16-4cec-92ae-ca5303703c6a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:17.433113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5bba38a5-fb16-4cec-92ae-ca5303703c6a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:17.440543 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bba38a5-fb16-4cec-92ae-ca5303703c6a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:17.440776 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bba38a5-fb16-4cec-92ae-ca5303703c6a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:17.441321 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bba38a5-fb16-4cec-92ae-ca5303703c6a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:17.442146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bba38a5-fb16-4cec-92ae-ca5303703c6a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:17.443007 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bba38a5-fb16-4cec-92ae-ca5303703c6a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:17.443443 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bba38a5-fb16-4cec-92ae-ca5303703c6a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:17.494907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-cd7d4685-37be-4e99-bcff-bfd0065befa8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:17.525137 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-cd7d4685-37be-4e99-bcff-bfd0065befa8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:17.528599 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-cd7d4685-37be-4e99-bcff-bfd0065befa8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:17.530875 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-cd7d4685-37be-4e99-bcff-bfd0065befa8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.495023 Aug 08 16:54:17.531823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 170/345] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:17 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:54:17.559591 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-5bba38a5-fb16-4cec-92ae-ca5303703c6a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:17.571984 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5bba38a5-fb16-4cec-92ae-ca5303703c6a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1223 microversion: 2.1 time: 0.144420 Aug 08 16:54:17.572893 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 176/346] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:17 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1223 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:18.131422 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c3dd5be8-23ab-41c7-a17a-2944c8a869cb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:18.131932 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c3dd5be8-23ab-41c7-a17a-2944c8a869cb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:18.139212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3dd5be8-23ab-41c7-a17a-2944c8a869cb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:18.139949 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3dd5be8-23ab-41c7-a17a-2944c8a869cb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:18.140510 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3dd5be8-23ab-41c7-a17a-2944c8a869cb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:18.141347 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3dd5be8-23ab-41c7-a17a-2944c8a869cb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:18.141913 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3dd5be8-23ab-41c7-a17a-2944c8a869cb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:18.142523 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3dd5be8-23ab-41c7-a17a-2944c8a869cb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:18.148273 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=100 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:18.365442 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c3dd5be8-23ab-41c7-a17a-2944c8a869cb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:18.376015 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c3dd5be8-23ab-41c7-a17a-2944c8a869cb tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1505 microversion: 2.1 time: 0.249113 Aug 08 16:54:18.376842 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 171/347] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:18 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:18.382892 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4deb6fe5-9910-4424-91f7-0053740966e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "153a3016-da47-456e-9992-fa3763b2943f"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:18.385492 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4deb6fe5-9910-4424-91f7-0053740966e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:18.392254 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4deb6fe5-9910-4424-91f7-0053740966e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:18.393681 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4deb6fe5-9910-4424-91f7-0053740966e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:18.394524 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4deb6fe5-9910-4424-91f7-0053740966e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:18.398686 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4deb6fe5-9910-4424-91f7-0053740966e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:18.398686 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4deb6fe5-9910-4424-91f7-0053740966e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:18.398686 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4deb6fe5-9910-4424-91f7-0053740966e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:18.436845 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-73d935f5-f690-49ec-b045-1e99adc68dbc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:18.437867 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-73d935f5-f690-49ec-b045-1e99adc68dbc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:18.449209 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-73d935f5-f690-49ec-b045-1e99adc68dbc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:18.450066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-73d935f5-f690-49ec-b045-1e99adc68dbc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:18.450991 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-73d935f5-f690-49ec-b045-1e99adc68dbc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:18.452248 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-73d935f5-f690-49ec-b045-1e99adc68dbc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:18.453161 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-73d935f5-f690-49ec-b045-1e99adc68dbc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:18.453908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-73d935f5-f690-49ec-b045-1e99adc68dbc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:18.849615 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-73d935f5-f690-49ec-b045-1e99adc68dbc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:18.872246 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-73d935f5-f690-49ec-b045-1e99adc68dbc tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.439995 Aug 08 16:54:18.873213 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 172/348] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:18 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:18.886471 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-38ded602-7a6b-4306-a8da-59460bb02a3e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:18.904002 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-38ded602-7a6b-4306-a8da-59460bb02a3e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:18.922444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-38ded602-7a6b-4306-a8da-59460bb02a3e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:18.940980 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-38ded602-7a6b-4306-a8da-59460bb02a3e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:18.942313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-38ded602-7a6b-4306-a8da-59460bb02a3e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:18.943845 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-38ded602-7a6b-4306-a8da-59460bb02a3e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:18.944777 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-38ded602-7a6b-4306-a8da-59460bb02a3e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:18.945508 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-38ded602-7a6b-4306-a8da-59460bb02a3e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:19.336959 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-38ded602-7a6b-4306-a8da-59460bb02a3e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:19.350846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-38ded602-7a6b-4306-a8da-59460bb02a3e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:19.354102 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-38ded602-7a6b-4306-a8da-59460bb02a3e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:19.355912 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-38ded602-7a6b-4306-a8da-59460bb02a3e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.476294 Aug 08 16:54:19.357042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 173/349] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:18 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:19.383741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-bde9a2b7-0360-4399-b7a7-cc29d8a06518 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:19.394893 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-bde9a2b7-0360-4399-b7a7-cc29d8a06518 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:19.403245 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bde9a2b7-0360-4399-b7a7-cc29d8a06518 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:19.404894 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bde9a2b7-0360-4399-b7a7-cc29d8a06518 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:19.404894 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bde9a2b7-0360-4399-b7a7-cc29d8a06518 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:19.405923 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bde9a2b7-0360-4399-b7a7-cc29d8a06518 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:19.406667 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bde9a2b7-0360-4399-b7a7-cc29d8a06518 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:19.407303 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bde9a2b7-0360-4399-b7a7-cc29d8a06518 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:19.496789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-bde9a2b7-0360-4399-b7a7-cc29d8a06518 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:19.506195 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-bde9a2b7-0360-4399-b7a7-cc29d8a06518 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1271 microversion: 2.1 time: 0.142129 Aug 08 16:54:19.507178 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 174/350] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:19 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:19.512172 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-cf1a1f98-96c3-4619-9471-914379b69793 req-28dd7310-89b1-45ef-b32a-4a3db05a8da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70c7402-29f3-48b0-b5fc-dd586f6e4266", "tag": "ee6f4872-65bc-467b-9551-24824a3b32ad"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:19.523942 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-cf1a1f98-96c3-4619-9471-914379b69793 req-28dd7310-89b1-45ef-b32a-4a3db05a8da5 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:19.524724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-cf1a1f98-96c3-4619-9471-914379b69793 req-28dd7310-89b1-45ef-b32a-4a3db05a8da5 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:19.525786 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-cf1a1f98-96c3-4619-9471-914379b69793 req-28dd7310-89b1-45ef-b32a-4a3db05a8da5 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:19.540621 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-cf1a1f98-96c3-4619-9471-914379b69793 req-28dd7310-89b1-45ef-b32a-4a3db05a8da5 service nova] Creating event network-changed:ee6f4872-65bc-467b-9551-24824a3b32ad for instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 on hv-cinder-85220 Aug 08 16:54:19.547063 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-cf1a1f98-96c3-4619-9471-914379b69793 req-28dd7310-89b1-45ef-b32a-4a3db05a8da5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038379 Aug 08 16:54:19.548025 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 175/351] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:54:19.555372 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-11d7ccf2-f48b-4ae8-918c-45132f13ca67 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:19.556618 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-11d7ccf2-f48b-4ae8-918c-45132f13ca67 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:19.565227 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11d7ccf2-f48b-4ae8-918c-45132f13ca67 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:19.568280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11d7ccf2-f48b-4ae8-918c-45132f13ca67 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:19.568280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11d7ccf2-f48b-4ae8-918c-45132f13ca67 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:19.568280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11d7ccf2-f48b-4ae8-918c-45132f13ca67 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:19.568280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11d7ccf2-f48b-4ae8-918c-45132f13ca67 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:19.569637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11d7ccf2-f48b-4ae8-918c-45132f13ca67 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:19.846834 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-11d7ccf2-f48b-4ae8-918c-45132f13ca67 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:19.859830 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-11d7ccf2-f48b-4ae8-918c-45132f13ca67 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1505 microversion: 2.1 time: 0.307362 Aug 08 16:54:19.872089 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 176/352] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:19 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:19.896484 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c3b6b9ea-21f4-44bc-9c77-d8fd489ee2ea tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:19.897222 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c3b6b9ea-21f4-44bc-9c77-d8fd489ee2ea tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:19.913025 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4deb6fe5-9910-4424-91f7-0053740966e3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "POST /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.534514 Aug 08 16:54:19.920492 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 177/353] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 16:54:18 2022] POST /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 194 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:54:19.939154 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3b6b9ea-21f4-44bc-9c77-d8fd489ee2ea tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:19.941398 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3b6b9ea-21f4-44bc-9c77-d8fd489ee2ea tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:19.947227 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3b6b9ea-21f4-44bc-9c77-d8fd489ee2ea tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:19.951010 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3b6b9ea-21f4-44bc-9c77-d8fd489ee2ea tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:19.952661 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3b6b9ea-21f4-44bc-9c77-d8fd489ee2ea tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:19.961515 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3b6b9ea-21f4-44bc-9c77-d8fd489ee2ea tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:20.084364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-516f2828-454d-40ac-998e-2e143ce4ae66 req-ea832546-7387-486a-a42d-9a30584644ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45555d44-c320-4537-a7ee-bcfee4a85bfe", "name": "network-vif-deleted", "tag": "ebd8a852-5060-4745-aa5f-eecf07bcb79f"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:20.108187 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-516f2828-454d-40ac-998e-2e143ce4ae66 req-ea832546-7387-486a-a42d-9a30584644ac service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:20.110014 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-516f2828-454d-40ac-998e-2e143ce4ae66 req-ea832546-7387-486a-a42d-9a30584644ac service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:20.112606 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-516f2828-454d-40ac-998e-2e143ce4ae66 req-ea832546-7387-486a-a42d-9a30584644ac service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:20.154034 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-516f2828-454d-40ac-998e-2e143ce4ae66 req-ea832546-7387-486a-a42d-9a30584644ac service nova] Creating event network-vif-deleted:ebd8a852-5060-4745-aa5f-eecf07bcb79f for instance 45555d44-c320-4537-a7ee-bcfee4a85bfe on hv-cinder-85220 Aug 08 16:54:20.195329 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-516f2828-454d-40ac-998e-2e143ce4ae66 req-ea832546-7387-486a-a42d-9a30584644ac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113350 Aug 08 16:54:20.199990 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 178/354] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:54:20.387798 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9c2e36b0-84ea-4121-af98-1096f5b79b53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:20.388560 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9c2e36b0-84ea-4121-af98-1096f5b79b53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:20.434344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9c2e36b0-84ea-4121-af98-1096f5b79b53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:20.440795 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9c2e36b0-84ea-4121-af98-1096f5b79b53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:20.445344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9c2e36b0-84ea-4121-af98-1096f5b79b53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:20.445344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9c2e36b0-84ea-4121-af98-1096f5b79b53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:20.445344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9c2e36b0-84ea-4121-af98-1096f5b79b53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:20.445344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9c2e36b0-84ea-4121-af98-1096f5b79b53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:20.471504 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:20.840819 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9c2e36b0-84ea-4121-af98-1096f5b79b53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:20.877569 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9c2e36b0-84ea-4121-af98-1096f5b79b53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:20.879515 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9c2e36b0-84ea-4121-af98-1096f5b79b53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:20.889950 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9c2e36b0-84ea-4121-af98-1096f5b79b53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.509151 Aug 08 16:54:20.896332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 179/355] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:20 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:20.930003 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-577d8e42-3a66-419a-9ba6-58ecd5f91c0f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:20.931879 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-577d8e42-3a66-419a-9ba6-58ecd5f91c0f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:20.951395 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-577d8e42-3a66-419a-9ba6-58ecd5f91c0f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:20.952200 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-577d8e42-3a66-419a-9ba6-58ecd5f91c0f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:20.952786 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-577d8e42-3a66-419a-9ba6-58ecd5f91c0f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:20.953749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-577d8e42-3a66-419a-9ba6-58ecd5f91c0f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:20.954376 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-577d8e42-3a66-419a-9ba6-58ecd5f91c0f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:20.955034 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-577d8e42-3a66-419a-9ba6-58ecd5f91c0f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:20.989987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c3b6b9ea-21f4-44bc-9c77-d8fd489ee2ea tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:21.004310 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c3b6b9ea-21f4-44bc-9c77-d8fd489ee2ea tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 1.113436 Aug 08 16:54:21.005278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 177/356] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:19 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:21.014410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:21.015729 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:21.055813 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:21.056550 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:21.057278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:21.058533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:21.059371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:21.060317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:21.090325 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-577d8e42-3a66-419a-9ba6-58ecd5f91c0f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:21.107032 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-577d8e42-3a66-419a-9ba6-58ecd5f91c0f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1289 microversion: 2.1 time: 0.210754 Aug 08 16:54:21.113724 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 180/357] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:20 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1289 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:21.125268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:21.126545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:21.128363 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:21.129600 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lazy-loading 'fault' on Instance uuid 45555d44-c320-4537-a7ee-bcfee4a85bfe {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:54:21.131618 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-448104fc-3b32-475d-a1ad-5850ecaa2e68 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8edda708-73a1-4bb4-bad8-098005b0af9b"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:21.134299 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-448104fc-3b32-475d-a1ad-5850ecaa2e68 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:21.145630 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-448104fc-3b32-475d-a1ad-5850ecaa2e68 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:21.146599 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-448104fc-3b32-475d-a1ad-5850ecaa2e68 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:21.147309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-448104fc-3b32-475d-a1ad-5850ecaa2e68 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:21.148405 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-448104fc-3b32-475d-a1ad-5850ecaa2e68 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:21.149201 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-448104fc-3b32-475d-a1ad-5850ecaa2e68 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:21.149788 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-448104fc-3b32-475d-a1ad-5850ecaa2e68 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:21.225397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:21.245650 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-56d2f766-6c41-4f8d-b654-1383c10ccb7f tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1304 microversion: 2.1 time: 0.238253 Aug 08 16:54:21.247061 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 178/358] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:21 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1304 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:21.943667 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f13be50c-6fd7-47ea-9b14-36fd89b86679 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:21.944565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f13be50c-6fd7-47ea-9b14-36fd89b86679 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:21.956343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f13be50c-6fd7-47ea-9b14-36fd89b86679 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:21.957151 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f13be50c-6fd7-47ea-9b14-36fd89b86679 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:21.957884 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f13be50c-6fd7-47ea-9b14-36fd89b86679 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:21.958952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f13be50c-6fd7-47ea-9b14-36fd89b86679 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:21.959683 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f13be50c-6fd7-47ea-9b14-36fd89b86679 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:21.960370 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f13be50c-6fd7-47ea-9b14-36fd89b86679 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:22.128403 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f13be50c-6fd7-47ea-9b14-36fd89b86679 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:22.141897 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f13be50c-6fd7-47ea-9b14-36fd89b86679 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:22.148108 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f13be50c-6fd7-47ea-9b14-36fd89b86679 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:22.148108 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f13be50c-6fd7-47ea-9b14-36fd89b86679 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.211476 Aug 08 16:54:22.148642 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 179/359] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:21 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:54:22.153833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b0e5aab0-6d66-4fa8-a1c4-b2a8598cb4cf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:22.154452 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b0e5aab0-6d66-4fa8-a1c4-b2a8598cb4cf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:22.163460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b0e5aab0-6d66-4fa8-a1c4-b2a8598cb4cf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:22.164309 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b0e5aab0-6d66-4fa8-a1c4-b2a8598cb4cf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:22.164922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b0e5aab0-6d66-4fa8-a1c4-b2a8598cb4cf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:22.165651 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b0e5aab0-6d66-4fa8-a1c4-b2a8598cb4cf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:22.166146 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b0e5aab0-6d66-4fa8-a1c4-b2a8598cb4cf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:22.166602 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b0e5aab0-6d66-4fa8-a1c4-b2a8598cb4cf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:22.335733 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b0e5aab0-6d66-4fa8-a1c4-b2a8598cb4cf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:22.352365 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b0e5aab0-6d66-4fa8-a1c4-b2a8598cb4cf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.201874 Aug 08 16:54:22.353635 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 180/360] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:22 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:22.362552 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a9ae6d0a-17f3-4803-8f6f-d2b54a626f1f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:22.363560 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a9ae6d0a-17f3-4803-8f6f-d2b54a626f1f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:22.375785 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a9ae6d0a-17f3-4803-8f6f-d2b54a626f1f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:22.381657 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a9ae6d0a-17f3-4803-8f6f-d2b54a626f1f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:22.381657 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a9ae6d0a-17f3-4803-8f6f-d2b54a626f1f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:22.381657 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a9ae6d0a-17f3-4803-8f6f-d2b54a626f1f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:22.381657 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a9ae6d0a-17f3-4803-8f6f-d2b54a626f1f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:22.382236 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a9ae6d0a-17f3-4803-8f6f-d2b54a626f1f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:22.643338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a9ae6d0a-17f3-4803-8f6f-d2b54a626f1f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:22.651835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a9ae6d0a-17f3-4803-8f6f-d2b54a626f1f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.297077 Aug 08 16:54:22.652605 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 181/361] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:22 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:22.657965 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:22.659064 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:22.670968 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:22.671637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:22.677378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:22.677378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:22.677378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:22.677378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:22.713568 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:22.714067 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:22.714734 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:22.722990 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lazy-loading 'fault' on Instance uuid 45555d44-c320-4537-a7ee-bcfee4a85bfe {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:54:22.766182 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fdea0388e34b1eb5bfff49a3de5b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec57970389084368ac985ecb58645bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:22.775663 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-aaf39aa8-d794-4291-bea9-abb53646dc96 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 200 len: 1304 microversion: 2.1 time: 0.121917 Aug 08 16:54:22.776261 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 182/362] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:22 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:23.179839 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-067d1d88-6535-413d-b6ea-3bc7dd8a4564 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:23.180759 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-067d1d88-6535-413d-b6ea-3bc7dd8a4564 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:23.192050 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-067d1d88-6535-413d-b6ea-3bc7dd8a4564 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:23.192871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-067d1d88-6535-413d-b6ea-3bc7dd8a4564 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:23.196399 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-067d1d88-6535-413d-b6ea-3bc7dd8a4564 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:23.197243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-067d1d88-6535-413d-b6ea-3bc7dd8a4564 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:23.197722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-067d1d88-6535-413d-b6ea-3bc7dd8a4564 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:23.201518 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-067d1d88-6535-413d-b6ea-3bc7dd8a4564 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:23.644324 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-067d1d88-6535-413d-b6ea-3bc7dd8a4564 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:23.669675 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-067d1d88-6535-413d-b6ea-3bc7dd8a4564 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:23.673200 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-067d1d88-6535-413d-b6ea-3bc7dd8a4564 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:23.676828 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-067d1d88-6535-413d-b6ea-3bc7dd8a4564 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.506023 Aug 08 16:54:23.677415 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=4 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:23.679462 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 183/363] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:23 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:54:23.703369 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=14 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:23.717053 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-875d8742-94f8-4f64-b4f9-d93b67d99987 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:23.718513 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-875d8742-94f8-4f64-b4f9-d93b67d99987 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:23.732493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-875d8742-94f8-4f64-b4f9-d93b67d99987 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:23.733573 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-875d8742-94f8-4f64-b4f9-d93b67d99987 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:23.734548 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-875d8742-94f8-4f64-b4f9-d93b67d99987 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:23.736969 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-875d8742-94f8-4f64-b4f9-d93b67d99987 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:23.737792 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-875d8742-94f8-4f64-b4f9-d93b67d99987 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:23.738706 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-875d8742-94f8-4f64-b4f9-d93b67d99987 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:24.028753 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-448104fc-3b32-475d-a1ad-5850ecaa2e68 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "POST /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.901545 Aug 08 16:54:24.031875 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 181/364] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 16:54:21 2022] POST /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/os-volume_attachments => generated 194 bytes in 2904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:54:24.038463 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ede28abd-9dd4-4bcb-a321-24c91b55e3e8 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:24.039674 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ede28abd-9dd4-4bcb-a321-24c91b55e3e8 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:24.049100 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ede28abd-9dd4-4bcb-a321-24c91b55e3e8 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:24.049756 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ede28abd-9dd4-4bcb-a321-24c91b55e3e8 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:24.050677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ede28abd-9dd4-4bcb-a321-24c91b55e3e8 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:24.052176 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ede28abd-9dd4-4bcb-a321-24c91b55e3e8 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:24.053003 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ede28abd-9dd4-4bcb-a321-24c91b55e3e8 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:24.053767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ede28abd-9dd4-4bcb-a321-24c91b55e3e8 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:24.212904 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-875d8742-94f8-4f64-b4f9-d93b67d99987 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:24.229338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-875d8742-94f8-4f64-b4f9-d93b67d99987 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.536401 Aug 08 16:54:24.238826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 184/365] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:23 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:24.244345 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-747c6cfa-a6bb-48b2-99ce-4f0f76514496 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:24.246285 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-747c6cfa-a6bb-48b2-99ce-4f0f76514496 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] [instance: 45555d44-c320-4537-a7ee-bcfee4a85bfe] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:24.279237 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-747c6cfa-a6bb-48b2-99ce-4f0f76514496 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:24.279237 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-747c6cfa-a6bb-48b2-99ce-4f0f76514496 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:24.279237 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-747c6cfa-a6bb-48b2-99ce-4f0f76514496 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:24.279893 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-747c6cfa-a6bb-48b2-99ce-4f0f76514496 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:24.281021 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-747c6cfa-a6bb-48b2-99ce-4f0f76514496 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:24.281816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-747c6cfa-a6bb-48b2-99ce-4f0f76514496 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:24.313300 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-747c6cfa-a6bb-48b2-99ce-4f0f76514496 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] HTTP exception thrown: Instance 45555d44-c320-4537-a7ee-bcfee4a85bfe could not be found. Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-747c6cfa-a6bb-48b2-99ce-4f0f76514496 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Request method failure captured: Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe HTTP/1.1 Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T9nhTXjoZVr6DubgpdSMvlYYqbY6ZXcfwCLHBZcaOa2CZvgX1hPijPdKGv8Op5fjR34LcU9iYWLDakahINRSejSYvEZ_XRIPJF1YHOWnp_UupDjDUHQdL1Z9QMcgKvAWK_B7XX3hopR3pdFsqr1B0NBHvLrhKeWrCoO5tL69C6Hk5U Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: ec57970389084368ac985ecb58645bd1 Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-VolumesActionsTest-328226349 Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:54:24.317042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:54:24.319776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ec57970389084368ac985ecb58645bd1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ec57970389084368ac985ecb58645bd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec57970389084368ac985ecb58645bd1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ec57970389084368ac985ecb58645bd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:54:24.319776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-VolumesActionsTest-328226349 Aug 08 16:54:24.319776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: ec57970389084368ac985ecb58645bd1 Aug 08 16:54:24.319776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-VolumesActionsTest-328226349 Aug 08 16:54:24.319776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-VolumesActionsTest-328226349-project Aug 08 16:54:24.319776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:54:24.319776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:54:24.319776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: 00fdea0388e34b1eb5bfff49a3de5b57 Aug 08 16:54:24.319776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-VolumesActionsTest-328226349-project Aug 08 16:54:24.319776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:54:24.319776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 45555d44-c320-4537-a7ee-bcfee4a85bfe could not be found. Aug 08 16:54:24.319776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '45555d44-c320-4537-a7ee-bcfee4a85bfe'} Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45555d44-c320-4537-a7ee-bcfee4a85bfe could not be found. Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:54:24.321340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45555d44-c320-4537-a7ee-bcfee4a85bfe could not be found. Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45555d44-c320-4537-a7ee-bcfee4a85bfe could not be found. Aug 08 16:54:24.325258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:54:24.331664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-747c6cfa-a6bb-48b2-99ce-4f0f76514496 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] Returning 404 to user: Instance 45555d44-c320-4537-a7ee-bcfee4a85bfe could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:54:24.333280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-747c6cfa-a6bb-48b2-99ce-4f0f76514496 tempest-VolumesActionsTest-328226349 tempest-VolumesActionsTest-328226349-project] 10.222.0.13 "GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe" status: 404 len: 111 microversion: 2.1 time: 0.097327 Aug 08 16:54:24.335191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 185/366] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:24 2022] GET /compute/v2.1/servers/45555d44-c320-4537-a7ee-bcfee4a85bfe => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:54:24.371610 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ede28abd-9dd4-4bcb-a321-24c91b55e3e8 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:24.391805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ede28abd-9dd4-4bcb-a321-24c91b55e3e8 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.358828 Aug 08 16:54:24.395273 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 182/367] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:24 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:24.657356 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-9610ba5c-a5ef-41c8-800b-59e312379db4 req-2068fbee-bd46-458e-87f9-0f9b53abd982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c162d1e6-28a1-4af7-a11f-8ac7b6912a35", "tag": "bfa4314e-54cb-4bcf-ad62-d4a047f3db20"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:24.707412 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-9610ba5c-a5ef-41c8-800b-59e312379db4 req-2068fbee-bd46-458e-87f9-0f9b53abd982 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:24.728506 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-9610ba5c-a5ef-41c8-800b-59e312379db4 req-2068fbee-bd46-458e-87f9-0f9b53abd982 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:24.729827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-67cc80eb-c565-427c-8b6b-a3bb94bd2671 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:24.731812 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-9610ba5c-a5ef-41c8-800b-59e312379db4 req-2068fbee-bd46-458e-87f9-0f9b53abd982 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:24.743257 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-67cc80eb-c565-427c-8b6b-a3bb94bd2671 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:24.759433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67cc80eb-c565-427c-8b6b-a3bb94bd2671 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:24.771351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67cc80eb-c565-427c-8b6b-a3bb94bd2671 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:24.772491 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67cc80eb-c565-427c-8b6b-a3bb94bd2671 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:24.774008 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67cc80eb-c565-427c-8b6b-a3bb94bd2671 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:24.775125 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67cc80eb-c565-427c-8b6b-a3bb94bd2671 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:24.784316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67cc80eb-c565-427c-8b6b-a3bb94bd2671 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:24.786712 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-9610ba5c-a5ef-41c8-800b-59e312379db4 req-2068fbee-bd46-458e-87f9-0f9b53abd982 service nova] Creating event network-changed:bfa4314e-54cb-4bcf-ad62-d4a047f3db20 for instance c162d1e6-28a1-4af7-a11f-8ac7b6912a35 on hv-cinder-85220 Aug 08 16:54:24.799851 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-9610ba5c-a5ef-41c8-800b-59e312379db4 req-2068fbee-bd46-458e-87f9-0f9b53abd982 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149484 Aug 08 16:54:24.801621 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 186/368] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:54:25.273503 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=10 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:25.282093 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-10a5d949-35c5-444a-82fc-2669ec720f9e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:25.284157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-10a5d949-35c5-444a-82fc-2669ec720f9e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:25.305151 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-10a5d949-35c5-444a-82fc-2669ec720f9e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:25.306483 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-10a5d949-35c5-444a-82fc-2669ec720f9e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:25.307539 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-10a5d949-35c5-444a-82fc-2669ec720f9e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:25.311221 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-10a5d949-35c5-444a-82fc-2669ec720f9e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:25.313390 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-10a5d949-35c5-444a-82fc-2669ec720f9e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:25.318156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-10a5d949-35c5-444a-82fc-2669ec720f9e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:25.335634 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-67cc80eb-c565-427c-8b6b-a3bb94bd2671 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:25.365800 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-67cc80eb-c565-427c-8b6b-a3bb94bd2671 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:25.370120 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-67cc80eb-c565-427c-8b6b-a3bb94bd2671 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:25.373219 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-67cc80eb-c565-427c-8b6b-a3bb94bd2671 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.654285 Aug 08 16:54:25.384603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 183/369] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:24 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:25.431317 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-27272cb1-88f9-4566-aa94-f2b4fe69f8ac tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:25.437134 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-27272cb1-88f9-4566-aa94-f2b4fe69f8ac tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:25.449598 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:25.466851 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27272cb1-88f9-4566-aa94-f2b4fe69f8ac tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:25.467868 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27272cb1-88f9-4566-aa94-f2b4fe69f8ac tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:25.468584 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27272cb1-88f9-4566-aa94-f2b4fe69f8ac tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:25.474592 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27272cb1-88f9-4566-aa94-f2b4fe69f8ac tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:25.475708 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27272cb1-88f9-4566-aa94-f2b4fe69f8ac tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:25.477522 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27272cb1-88f9-4566-aa94-f2b4fe69f8ac tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:25.697548 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-27272cb1-88f9-4566-aa94-f2b4fe69f8ac tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:25.710289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-27272cb1-88f9-4566-aa94-f2b4fe69f8ac tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.287636 Aug 08 16:54:25.711114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 184/370] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:25 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:25.726075 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-10a5d949-35c5-444a-82fc-2669ec720f9e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:25.755260 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-10a5d949-35c5-444a-82fc-2669ec720f9e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.479734 Aug 08 16:54:25.760303 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 187/371] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:25 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:26.424003 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9ec4d21a-49b0-4a88-84b9-53a9f25fde53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:26.426317 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9ec4d21a-49b0-4a88-84b9-53a9f25fde53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:26.440284 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9ec4d21a-49b0-4a88-84b9-53a9f25fde53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:26.441708 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9ec4d21a-49b0-4a88-84b9-53a9f25fde53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:26.442887 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9ec4d21a-49b0-4a88-84b9-53a9f25fde53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:26.444561 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9ec4d21a-49b0-4a88-84b9-53a9f25fde53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:26.445803 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9ec4d21a-49b0-4a88-84b9-53a9f25fde53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:26.447009 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9ec4d21a-49b0-4a88-84b9-53a9f25fde53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:26.652650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9ec4d21a-49b0-4a88-84b9-53a9f25fde53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:26.663105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9ec4d21a-49b0-4a88-84b9-53a9f25fde53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:26.664860 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9ec4d21a-49b0-4a88-84b9-53a9f25fde53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:26.665975 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9ec4d21a-49b0-4a88-84b9-53a9f25fde53 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.256201 Aug 08 16:54:26.666600 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 185/372] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:26 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:26.738701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-db4e1ee0-c92f-4f87-b1fd-934bcee4d2e5 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:26.740783 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-db4e1ee0-c92f-4f87-b1fd-934bcee4d2e5 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:26.753996 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-db4e1ee0-c92f-4f87-b1fd-934bcee4d2e5 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:26.754640 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-db4e1ee0-c92f-4f87-b1fd-934bcee4d2e5 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:26.755210 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-db4e1ee0-c92f-4f87-b1fd-934bcee4d2e5 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:26.757421 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-db4e1ee0-c92f-4f87-b1fd-934bcee4d2e5 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:26.757421 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-db4e1ee0-c92f-4f87-b1fd-934bcee4d2e5 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:26.757421 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-db4e1ee0-c92f-4f87-b1fd-934bcee4d2e5 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:26.789869 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fb3e9fa1-7e94-4106-8258-942b77d75671 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:26.791445 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fb3e9fa1-7e94-4106-8258-942b77d75671 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:26.805240 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb3e9fa1-7e94-4106-8258-942b77d75671 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:26.806041 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb3e9fa1-7e94-4106-8258-942b77d75671 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:26.806810 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb3e9fa1-7e94-4106-8258-942b77d75671 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:26.808005 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb3e9fa1-7e94-4106-8258-942b77d75671 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:26.808732 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb3e9fa1-7e94-4106-8258-942b77d75671 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:26.809745 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb3e9fa1-7e94-4106-8258-942b77d75671 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:27.040638 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-db4e1ee0-c92f-4f87-b1fd-934bcee4d2e5 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:27.053967 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-db4e1ee0-c92f-4f87-b1fd-934bcee4d2e5 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.323953 Aug 08 16:54:27.054592 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 188/373] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:26 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:27.094727 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fb3e9fa1-7e94-4106-8258-942b77d75671 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:27.104575 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fb3e9fa1-7e94-4106-8258-942b77d75671 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.322278 Aug 08 16:54:27.119064 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 186/374] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:26 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:27.691312 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8518845b-6eb9-4f46-be00-1e19429d38ac tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:27.692024 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8518845b-6eb9-4f46-be00-1e19429d38ac tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:27.694390 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:27.700279 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8518845b-6eb9-4f46-be00-1e19429d38ac tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:27.700765 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8518845b-6eb9-4f46-be00-1e19429d38ac tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:27.701207 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8518845b-6eb9-4f46-be00-1e19429d38ac tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:27.701911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8518845b-6eb9-4f46-be00-1e19429d38ac tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:27.702357 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8518845b-6eb9-4f46-be00-1e19429d38ac tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:27.702810 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8518845b-6eb9-4f46-be00-1e19429d38ac tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:27.707876 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=100 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:27.889930 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8518845b-6eb9-4f46-be00-1e19429d38ac tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:27.899516 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8518845b-6eb9-4f46-be00-1e19429d38ac tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:27.901102 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8518845b-6eb9-4f46-be00-1e19429d38ac tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:27.902274 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8518845b-6eb9-4f46-be00-1e19429d38ac tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.216756 Aug 08 16:54:27.903163 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 189/375] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:27 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:28.080407 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f45a438c-744a-48e0-a90c-fba514fae788 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:28.081463 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f45a438c-744a-48e0-a90c-fba514fae788 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:28.093759 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f45a438c-744a-48e0-a90c-fba514fae788 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:28.094626 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f45a438c-744a-48e0-a90c-fba514fae788 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:28.096025 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f45a438c-744a-48e0-a90c-fba514fae788 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:28.097281 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f45a438c-744a-48e0-a90c-fba514fae788 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:28.098114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f45a438c-744a-48e0-a90c-fba514fae788 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:28.098923 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f45a438c-744a-48e0-a90c-fba514fae788 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:28.128360 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5beda0b9-7043-429d-a91e-3e65853136da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:28.129019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5beda0b9-7043-429d-a91e-3e65853136da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:28.137416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5beda0b9-7043-429d-a91e-3e65853136da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:28.137996 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5beda0b9-7043-429d-a91e-3e65853136da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:28.138449 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5beda0b9-7043-429d-a91e-3e65853136da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:28.139221 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5beda0b9-7043-429d-a91e-3e65853136da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:28.139681 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5beda0b9-7043-429d-a91e-3e65853136da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:28.140107 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5beda0b9-7043-429d-a91e-3e65853136da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:28.299203 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f45a438c-744a-48e0-a90c-fba514fae788 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:28.319404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5beda0b9-7043-429d-a91e-3e65853136da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:28.324253 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f45a438c-744a-48e0-a90c-fba514fae788 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.243884 Aug 08 16:54:28.328480 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 187/376] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:28 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:28.331816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5beda0b9-7043-429d-a91e-3e65853136da tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.207712 Aug 08 16:54:28.332827 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 190/377] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:28 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:28.929913 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ae1d66e0-0221-4ae3-8889-886d4233eae4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:28.930927 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ae1d66e0-0221-4ae3-8889-886d4233eae4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:28.941903 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae1d66e0-0221-4ae3-8889-886d4233eae4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:28.942793 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae1d66e0-0221-4ae3-8889-886d4233eae4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:28.943545 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae1d66e0-0221-4ae3-8889-886d4233eae4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:28.944790 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae1d66e0-0221-4ae3-8889-886d4233eae4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:28.945609 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae1d66e0-0221-4ae3-8889-886d4233eae4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:28.946378 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae1d66e0-0221-4ae3-8889-886d4233eae4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:29.108296 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ae1d66e0-0221-4ae3-8889-886d4233eae4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:29.124322 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ae1d66e0-0221-4ae3-8889-886d4233eae4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:29.127259 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ae1d66e0-0221-4ae3-8889-886d4233eae4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:29.128805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ae1d66e0-0221-4ae3-8889-886d4233eae4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.207173 Aug 08 16:54:29.129573 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 188/378] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:28 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:29.366434 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-87ccba32-fc86-4bff-b4ab-22b3692b1f9c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:29.367048 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a4a62499-a9f5-4294-ac86-62b42a9098ba tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:29.367147 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-87ccba32-fc86-4bff-b4ab-22b3692b1f9c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:29.367374 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a4a62499-a9f5-4294-ac86-62b42a9098ba tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:29.373814 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4a62499-a9f5-4294-ac86-62b42a9098ba tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:29.377379 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4a62499-a9f5-4294-ac86-62b42a9098ba tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:29.377379 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4a62499-a9f5-4294-ac86-62b42a9098ba tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:29.377379 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4a62499-a9f5-4294-ac86-62b42a9098ba tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:29.377662 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-87ccba32-fc86-4bff-b4ab-22b3692b1f9c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:29.377769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4a62499-a9f5-4294-ac86-62b42a9098ba tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:29.377769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4a62499-a9f5-4294-ac86-62b42a9098ba tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:29.377909 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-87ccba32-fc86-4bff-b4ab-22b3692b1f9c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:29.378298 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-87ccba32-fc86-4bff-b4ab-22b3692b1f9c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:29.379343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-87ccba32-fc86-4bff-b4ab-22b3692b1f9c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:29.379820 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-87ccba32-fc86-4bff-b4ab-22b3692b1f9c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:29.380415 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-87ccba32-fc86-4bff-b4ab-22b3692b1f9c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:29.588263 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a4a62499-a9f5-4294-ac86-62b42a9098ba tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:29.604503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a4a62499-a9f5-4294-ac86-62b42a9098ba tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.241459 Aug 08 16:54:29.605680 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 189/379] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:29 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:29.608237 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-87ccba32-fc86-4bff-b4ab-22b3692b1f9c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:29.622027 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-87ccba32-fc86-4bff-b4ab-22b3692b1f9c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.262118 Aug 08 16:54:29.622771 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 191/380] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:29 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:30.160903 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ddaffbf0-2443-4105-b02c-4f77b3ade473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:30.161973 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ddaffbf0-2443-4105-b02c-4f77b3ade473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:30.170063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ddaffbf0-2443-4105-b02c-4f77b3ade473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:30.170677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ddaffbf0-2443-4105-b02c-4f77b3ade473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:30.171277 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ddaffbf0-2443-4105-b02c-4f77b3ade473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:30.172075 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ddaffbf0-2443-4105-b02c-4f77b3ade473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:30.172662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ddaffbf0-2443-4105-b02c-4f77b3ade473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:30.173188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ddaffbf0-2443-4105-b02c-4f77b3ade473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:30.335608 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ddaffbf0-2443-4105-b02c-4f77b3ade473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:30.344350 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ddaffbf0-2443-4105-b02c-4f77b3ade473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:30.346709 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ddaffbf0-2443-4105-b02c-4f77b3ade473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:30.348344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ddaffbf0-2443-4105-b02c-4f77b3ade473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.191378 Aug 08 16:54:30.348769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 190/381] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:30 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:54:30.627425 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-11e76d77-af41-42eb-9d72-a922c6846d48 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:30.628079 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-11e76d77-af41-42eb-9d72-a922c6846d48 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:30.635295 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11e76d77-af41-42eb-9d72-a922c6846d48 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:30.635802 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11e76d77-af41-42eb-9d72-a922c6846d48 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:30.636247 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11e76d77-af41-42eb-9d72-a922c6846d48 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:30.636986 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11e76d77-af41-42eb-9d72-a922c6846d48 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:30.637447 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11e76d77-af41-42eb-9d72-a922c6846d48 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:30.637876 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11e76d77-af41-42eb-9d72-a922c6846d48 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:30.650686 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-27c3ac0f-dc2b-4435-80ec-33e4b8159c8b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:30.651497 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-27c3ac0f-dc2b-4435-80ec-33e4b8159c8b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:30.659366 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27c3ac0f-dc2b-4435-80ec-33e4b8159c8b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:30.660081 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27c3ac0f-dc2b-4435-80ec-33e4b8159c8b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:30.660328 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27c3ac0f-dc2b-4435-80ec-33e4b8159c8b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:30.661057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27c3ac0f-dc2b-4435-80ec-33e4b8159c8b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:30.661516 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27c3ac0f-dc2b-4435-80ec-33e4b8159c8b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:30.661950 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27c3ac0f-dc2b-4435-80ec-33e4b8159c8b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:30.829030 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-11e76d77-af41-42eb-9d72-a922c6846d48 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:30.841050 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-11e76d77-af41-42eb-9d72-a922c6846d48 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.217898 Aug 08 16:54:30.842052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 192/382] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:30 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:30.855902 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-27c3ac0f-dc2b-4435-80ec-33e4b8159c8b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:30.871320 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-27c3ac0f-dc2b-4435-80ec-33e4b8159c8b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.224446 Aug 08 16:54:30.872492 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 191/383] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:30 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:31.293684 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-b643bae2-b5ac-42d5-8d02-e767f20c2790 req-e492aec1-8982-4b76-83d1-9449581b44ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70c7402-29f3-48b0-b5fc-dd586f6e4266", "name": "network-vif-plugged", "status": "completed", "tag": "ee6f4872-65bc-467b-9551-24824a3b32ad"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:31.306687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b643bae2-b5ac-42d5-8d02-e767f20c2790 req-e492aec1-8982-4b76-83d1-9449581b44ca service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:31.307237 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b643bae2-b5ac-42d5-8d02-e767f20c2790 req-e492aec1-8982-4b76-83d1-9449581b44ca service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:31.307715 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b643bae2-b5ac-42d5-8d02-e767f20c2790 req-e492aec1-8982-4b76-83d1-9449581b44ca service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:31.321628 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-b643bae2-b5ac-42d5-8d02-e767f20c2790 req-e492aec1-8982-4b76-83d1-9449581b44ca service nova] Creating event network-vif-plugged:ee6f4872-65bc-467b-9551-24824a3b32ad for instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 on hv-cinder-85220 Aug 08 16:54:31.327720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-b643bae2-b5ac-42d5-8d02-e767f20c2790 req-e492aec1-8982-4b76-83d1-9449581b44ca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038969 Aug 08 16:54:31.329043 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 193/384] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:54:31.377026 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-67e67f1e-1908-44dd-bebb-a500ff7723cf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:31.386219 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-67e67f1e-1908-44dd-bebb-a500ff7723cf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:31.390012 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67e67f1e-1908-44dd-bebb-a500ff7723cf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:31.390508 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67e67f1e-1908-44dd-bebb-a500ff7723cf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:31.390981 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67e67f1e-1908-44dd-bebb-a500ff7723cf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:31.391696 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67e67f1e-1908-44dd-bebb-a500ff7723cf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:31.392814 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67e67f1e-1908-44dd-bebb-a500ff7723cf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:31.393570 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67e67f1e-1908-44dd-bebb-a500ff7723cf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:31.564415 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-67e67f1e-1908-44dd-bebb-a500ff7723cf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:31.582717 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-67e67f1e-1908-44dd-bebb-a500ff7723cf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:31.584755 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-67e67f1e-1908-44dd-bebb-a500ff7723cf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:31.586226 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-67e67f1e-1908-44dd-bebb-a500ff7723cf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.216723 Aug 08 16:54:31.587003 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 192/385] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:31 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:31.880995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-578b5a7a-4c39-45d8-aa34-fc565ab5f6d3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:31.881832 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-578b5a7a-4c39-45d8-aa34-fc565ab5f6d3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:31.889610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-578b5a7a-4c39-45d8-aa34-fc565ab5f6d3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:31.890113 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-578b5a7a-4c39-45d8-aa34-fc565ab5f6d3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:31.890552 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-578b5a7a-4c39-45d8-aa34-fc565ab5f6d3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:31.891426 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-578b5a7a-4c39-45d8-aa34-fc565ab5f6d3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:31.892895 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-578b5a7a-4c39-45d8-aa34-fc565ab5f6d3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:31.893437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-578b5a7a-4c39-45d8-aa34-fc565ab5f6d3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:31.901170 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-cef01c23-2aee-4c03-8aca-174efa6a05fe tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:31.905601 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-cef01c23-2aee-4c03-8aca-174efa6a05fe tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:31.914358 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cef01c23-2aee-4c03-8aca-174efa6a05fe tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:31.915321 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cef01c23-2aee-4c03-8aca-174efa6a05fe tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:31.916114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cef01c23-2aee-4c03-8aca-174efa6a05fe tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:31.917336 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cef01c23-2aee-4c03-8aca-174efa6a05fe tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:31.918152 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cef01c23-2aee-4c03-8aca-174efa6a05fe tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:31.921036 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cef01c23-2aee-4c03-8aca-174efa6a05fe tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:32.231336 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-578b5a7a-4c39-45d8-aa34-fc565ab5f6d3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:32.240305 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-cef01c23-2aee-4c03-8aca-174efa6a05fe tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:32.243620 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-578b5a7a-4c39-45d8-aa34-fc565ab5f6d3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.370981 Aug 08 16:54:32.244220 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 194/386] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:31 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:32.250329 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-cef01c23-2aee-4c03-8aca-174efa6a05fe tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.359230 Aug 08 16:54:32.251671 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 193/387] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:31 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:32.625709 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-55ade0d2-de29-4bcb-b690-31c8e03fd6ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:32.627317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-55ade0d2-de29-4bcb-b690-31c8e03fd6ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:32.636225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-55ade0d2-de29-4bcb-b690-31c8e03fd6ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:32.637560 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-55ade0d2-de29-4bcb-b690-31c8e03fd6ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:32.638210 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-55ade0d2-de29-4bcb-b690-31c8e03fd6ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:32.639270 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-55ade0d2-de29-4bcb-b690-31c8e03fd6ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:32.639807 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-55ade0d2-de29-4bcb-b690-31c8e03fd6ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:32.640347 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-55ade0d2-de29-4bcb-b690-31c8e03fd6ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:33.004303 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-55ade0d2-de29-4bcb-b690-31c8e03fd6ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:33.048745 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-55ade0d2-de29-4bcb-b690-31c8e03fd6ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:33.051807 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-55ade0d2-de29-4bcb-b690-31c8e03fd6ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:33.054264 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-55ade0d2-de29-4bcb-b690-31c8e03fd6ed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.442784 Aug 08 16:54:33.055619 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 195/388] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:32 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:33.278804 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-78b2a8ca-6f37-4b38-9ad7-223b76e6849c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:33.284084 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-78b2a8ca-6f37-4b38-9ad7-223b76e6849c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:33.287558 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-67efc50a-5d40-46e2-9cd7-ccd6791c62c9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:33.288585 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-67efc50a-5d40-46e2-9cd7-ccd6791c62c9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:33.296861 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-67efc50a-5d40-46e2-9cd7-ccd6791c62c9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:33.297692 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-67efc50a-5d40-46e2-9cd7-ccd6791c62c9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:33.305688 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78b2a8ca-6f37-4b38-9ad7-223b76e6849c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:33.306527 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78b2a8ca-6f37-4b38-9ad7-223b76e6849c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:33.307314 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78b2a8ca-6f37-4b38-9ad7-223b76e6849c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:33.308605 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78b2a8ca-6f37-4b38-9ad7-223b76e6849c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:33.314460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-67efc50a-5d40-46e2-9cd7-ccd6791c62c9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:33.317005 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-67efc50a-5d40-46e2-9cd7-ccd6791c62c9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:33.317894 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-67efc50a-5d40-46e2-9cd7-ccd6791c62c9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:33.319252 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-67efc50a-5d40-46e2-9cd7-ccd6791c62c9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:33.324041 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78b2a8ca-6f37-4b38-9ad7-223b76e6849c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:33.325079 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78b2a8ca-6f37-4b38-9ad7-223b76e6849c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:33.424985 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:33.699343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-78b2a8ca-6f37-4b38-9ad7-223b76e6849c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:33.708222 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-67efc50a-5d40-46e2-9cd7-ccd6791c62c9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:33.719501 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-78b2a8ca-6f37-4b38-9ad7-223b76e6849c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.449564 Aug 08 16:54:33.725228 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-67efc50a-5d40-46e2-9cd7-ccd6791c62c9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1503 microversion: 2.1 time: 0.444087 Aug 08 16:54:33.737153 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 194/390] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:33 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:33.737450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 196/390] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:33 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1503 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:33.764490 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-cd9fd825-a016-48c6-b0bb-5099b01043b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "836727a7-075c-46ef-bbf5-58db60174a94"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:33.769659 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-cd9fd825-a016-48c6-b0bb-5099b01043b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:33.781391 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cd9fd825-a016-48c6-b0bb-5099b01043b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:33.782155 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cd9fd825-a016-48c6-b0bb-5099b01043b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:33.783780 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cd9fd825-a016-48c6-b0bb-5099b01043b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:33.785041 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cd9fd825-a016-48c6-b0bb-5099b01043b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:33.785797 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cd9fd825-a016-48c6-b0bb-5099b01043b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:33.786448 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cd9fd825-a016-48c6-b0bb-5099b01043b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:33.841166 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-cd9fd825-a016-48c6-b0bb-5099b01043b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] HTTP exception thrown: Cannot 'attach_volume' instance 65990fbf-4d36-42ed-8f3b-3406d373841a while it is in vm_state rescued Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-cd9fd825-a016-48c6-b0bb-5099b01043b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Request method failure captured: Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: POST /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a/os-volume_attachments HTTP/1.1 Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 74 Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T8w-K7laAEb2eqcpAcIQgFUL6kuL4XLbKHs4o9M-2KdcOOU83uXV2cxJjak-BJlSZljXiBu3GBNqSP4Yv2wtKGu8Kt7fn3jcSbSzg6UkIEqkYSp3Fw6_bcPoQdHG8VL8tlrNTQRdwt7oFp1kxR960UJj4ylfDEF571Gojp3_bb3VaQ Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: 6cac5ca5a8b04bce9a9d8ac938cd35e8 Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 16:54:33.849385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 16:54:33.851185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6cac5ca5a8b04bce9a9d8ac938cd35e8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:54:33.851185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:54:33.851185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: 6cac5ca5a8b04bce9a9d8ac938cd35e8 Aug 08 16:54:33.851185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:54:33.851185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-ServerRescueNegativeTestJSON-1491888347-project Aug 08 16:54:33.851185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 16:54:33.851185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 16:54:33.851185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: 75d793a42ec74232899b7a19e36b5867 Aug 08 16:54:33.851185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491888347-project Aug 08 16:54:33.851185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Aug 08 16:54:33.851185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {"volumeAttachment": {"volumeId": "836727a7-075c-46ef-bbf5-58db60174a94"}} Aug 08 16:54:33.851185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Cannot 'attach_volume' instance 65990fbf-4d36-42ed-8f3b-3406d373841a while it is in vm_state rescued Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'server_id': '65990fbf-4d36-42ed-8f3b-3406d373841a', 'body': {'volumeAttachment': {'volumeId': '836727a7-075c-46ef-bbf5-58db60174a94'}}} Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 65990fbf-4d36-42ed-8f3b-3406d373841a in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:54:33.852163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 65990fbf-4d36-42ed-8f3b-3406d373841a while it is in vm_state rescued Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:54:33.853580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:54:33.855002 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:54:33.855002 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:54:33.855002 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 65990fbf-4d36-42ed-8f3b-3406d373841a while it is in vm_state rescued Aug 08 16:54:33.855002 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:54:33.855002 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-cd9fd825-a016-48c6-b0bb-5099b01043b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Returning 409 to user: Cannot 'attach_volume' instance 65990fbf-4d36-42ed-8f3b-3406d373841a while it is in vm_state rescued {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:54:33.855002 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-cd9fd825-a016-48c6-b0bb-5099b01043b3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "POST /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.096222 Aug 08 16:54:33.855002 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 195/391] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 16:54:33 2022] POST /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a/os-volume_attachments => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 16:54:33.886422 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8ef14c62-964a-4cc3-8bbd-e16b6338bcb7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:33.887448 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8ef14c62-964a-4cc3-8bbd-e16b6338bcb7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:33.904227 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8ef14c62-964a-4cc3-8bbd-e16b6338bcb7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:33.905065 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8ef14c62-964a-4cc3-8bbd-e16b6338bcb7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:33.905742 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8ef14c62-964a-4cc3-8bbd-e16b6338bcb7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:33.906736 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8ef14c62-964a-4cc3-8bbd-e16b6338bcb7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:33.910269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8ef14c62-964a-4cc3-8bbd-e16b6338bcb7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:33.911248 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8ef14c62-964a-4cc3-8bbd-e16b6338bcb7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:34.092506 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1745a011-82d4-4d13-ad53-6bfcb6d3fcfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:34.100611 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1745a011-82d4-4d13-ad53-6bfcb6d3fcfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:34.136329 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1745a011-82d4-4d13-ad53-6bfcb6d3fcfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:34.136329 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1745a011-82d4-4d13-ad53-6bfcb6d3fcfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:34.136329 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1745a011-82d4-4d13-ad53-6bfcb6d3fcfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:34.136329 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1745a011-82d4-4d13-ad53-6bfcb6d3fcfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:34.138228 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1745a011-82d4-4d13-ad53-6bfcb6d3fcfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:34.139839 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1745a011-82d4-4d13-ad53-6bfcb6d3fcfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:34.261825 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8ef14c62-964a-4cc3-8bbd-e16b6338bcb7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "POST /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a/action" status: 202 len: 0 microversion: 2.1 time: 0.400272 Aug 08 16:54:34.268259 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 197/392] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 16:54:33 2022] POST /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:54:34.439073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c7da005d-ea47-415c-9edd-b67cb2359003 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:34.439073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c7da005d-ea47-415c-9edd-b67cb2359003 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:34.439073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c7da005d-ea47-415c-9edd-b67cb2359003 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:34.439073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c7da005d-ea47-415c-9edd-b67cb2359003 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:34.440052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c7da005d-ea47-415c-9edd-b67cb2359003 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:34.440052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c7da005d-ea47-415c-9edd-b67cb2359003 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:34.440052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c7da005d-ea47-415c-9edd-b67cb2359003 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:34.440052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c7da005d-ea47-415c-9edd-b67cb2359003 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:34.621563 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1745a011-82d4-4d13-ad53-6bfcb6d3fcfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:34.631319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1745a011-82d4-4d13-ad53-6bfcb6d3fcfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:34.639769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1745a011-82d4-4d13-ad53-6bfcb6d3fcfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:34.640996 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1745a011-82d4-4d13-ad53-6bfcb6d3fcfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.557516 Aug 08 16:54:34.644549 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 196/393] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:34 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:34.676293 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c7da005d-ea47-415c-9edd-b67cb2359003 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:34.706703 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c7da005d-ea47-415c-9edd-b67cb2359003 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1511 microversion: 2.1 time: 0.433980 Aug 08 16:54:34.709617 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 198/394] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:34 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1511 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:34.760434 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1762c41c-6147-41e8-a060-ec9ee4ad32fd tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:34.760434 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1762c41c-6147-41e8-a060-ec9ee4ad32fd tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:34.769045 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1762c41c-6147-41e8-a060-ec9ee4ad32fd tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:34.769900 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1762c41c-6147-41e8-a060-ec9ee4ad32fd tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:34.770697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1762c41c-6147-41e8-a060-ec9ee4ad32fd tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:34.771656 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1762c41c-6147-41e8-a060-ec9ee4ad32fd tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:34.772324 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1762c41c-6147-41e8-a060-ec9ee4ad32fd tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:34.774146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1762c41c-6147-41e8-a060-ec9ee4ad32fd tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:35.070047 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1762c41c-6147-41e8-a060-ec9ee4ad32fd tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:35.082089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1762c41c-6147-41e8-a060-ec9ee4ad32fd tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.327803 Aug 08 16:54:35.083724 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 197/395] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:34 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:35.673858 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b1d669d5-30ef-40f6-a722-a16065bfc4c5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:35.676313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b1d669d5-30ef-40f6-a722-a16065bfc4c5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:35.698331 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b1d669d5-30ef-40f6-a722-a16065bfc4c5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:35.704838 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b1d669d5-30ef-40f6-a722-a16065bfc4c5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:35.707784 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b1d669d5-30ef-40f6-a722-a16065bfc4c5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:35.713285 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b1d669d5-30ef-40f6-a722-a16065bfc4c5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:35.714248 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b1d669d5-30ef-40f6-a722-a16065bfc4c5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:35.715482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b1d669d5-30ef-40f6-a722-a16065bfc4c5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:35.740420 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-09a848f5-f85f-405b-aed3-b1ca506ffb0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:35.742457 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-09a848f5-f85f-405b-aed3-b1ca506ffb0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:35.759453 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-09a848f5-f85f-405b-aed3-b1ca506ffb0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:35.761470 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-09a848f5-f85f-405b-aed3-b1ca506ffb0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:35.764560 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-09a848f5-f85f-405b-aed3-b1ca506ffb0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:35.765730 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-09a848f5-f85f-405b-aed3-b1ca506ffb0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:35.768465 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-09a848f5-f85f-405b-aed3-b1ca506ffb0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:35.769269 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-09a848f5-f85f-405b-aed3-b1ca506ffb0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:36.210087 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b1d669d5-30ef-40f6-a722-a16065bfc4c5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:36.234147 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b1d669d5-30ef-40f6-a722-a16065bfc4c5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:36.244245 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b1d669d5-30ef-40f6-a722-a16065bfc4c5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:36.248594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b1d669d5-30ef-40f6-a722-a16065bfc4c5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.581723 Aug 08 16:54:36.251953 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 199/396] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:35 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:36.263913 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5d10b368-5b06-41b9-b8de-361fb2236842 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:36.265768 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5d10b368-5b06-41b9-b8de-361fb2236842 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:36.343514 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5d10b368-5b06-41b9-b8de-361fb2236842 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:36.353607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-09a848f5-f85f-405b-aed3-b1ca506ffb0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:36.354120 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5d10b368-5b06-41b9-b8de-361fb2236842 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:36.360140 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5d10b368-5b06-41b9-b8de-361fb2236842 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:36.367816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5d10b368-5b06-41b9-b8de-361fb2236842 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:36.374691 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5d10b368-5b06-41b9-b8de-361fb2236842 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:36.375210 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-09a848f5-f85f-405b-aed3-b1ca506ffb0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1511 microversion: 2.1 time: 0.645577 Aug 08 16:54:36.382998 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 198/397] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:35 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1511 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:36.384427 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5d10b368-5b06-41b9-b8de-361fb2236842 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:36.756469 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5d10b368-5b06-41b9-b8de-361fb2236842 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:36.823109 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5d10b368-5b06-41b9-b8de-361fb2236842 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.563672 Aug 08 16:54:36.824560 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 200/398] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:36 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:37.307780 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9507ba25-9179-4aad-a302-07f4dde4848b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:37.310529 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9507ba25-9179-4aad-a302-07f4dde4848b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:37.328113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9507ba25-9179-4aad-a302-07f4dde4848b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:37.328628 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9507ba25-9179-4aad-a302-07f4dde4848b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:37.330289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9507ba25-9179-4aad-a302-07f4dde4848b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:37.331487 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9507ba25-9179-4aad-a302-07f4dde4848b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:37.333589 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9507ba25-9179-4aad-a302-07f4dde4848b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:37.335161 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9507ba25-9179-4aad-a302-07f4dde4848b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:37.415419 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f3e4f4e8-724e-435a-ae49-c3f86e2322a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:37.416273 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f3e4f4e8-724e-435a-ae49-c3f86e2322a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:37.441764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f3e4f4e8-724e-435a-ae49-c3f86e2322a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:37.442781 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f3e4f4e8-724e-435a-ae49-c3f86e2322a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:37.443827 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f3e4f4e8-724e-435a-ae49-c3f86e2322a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:37.446614 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f3e4f4e8-724e-435a-ae49-c3f86e2322a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:37.455863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f3e4f4e8-724e-435a-ae49-c3f86e2322a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:37.455863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f3e4f4e8-724e-435a-ae49-c3f86e2322a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:37.662304 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9507ba25-9179-4aad-a302-07f4dde4848b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:37.674021 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9507ba25-9179-4aad-a302-07f4dde4848b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:37.677620 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9507ba25-9179-4aad-a302-07f4dde4848b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:37.679689 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9507ba25-9179-4aad-a302-07f4dde4848b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.376879 Aug 08 16:54:37.681462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 199/399] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:37 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:37.844319 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f3e4f4e8-724e-435a-ae49-c3f86e2322a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:37.847707 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-933f34f9-ac03-49a4-b2dd-58ae8f7517d7 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:37.848346 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-933f34f9-ac03-49a4-b2dd-58ae8f7517d7 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:37.864246 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f3e4f4e8-724e-435a-ae49-c3f86e2322a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1511 microversion: 2.1 time: 0.461347 Aug 08 16:54:37.865173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 201/400] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:37 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1511 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:37.869331 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-933f34f9-ac03-49a4-b2dd-58ae8f7517d7 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:37.870722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-933f34f9-ac03-49a4-b2dd-58ae8f7517d7 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:37.871945 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-933f34f9-ac03-49a4-b2dd-58ae8f7517d7 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:37.876029 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-933f34f9-ac03-49a4-b2dd-58ae8f7517d7 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:37.879386 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-933f34f9-ac03-49a4-b2dd-58ae8f7517d7 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:37.892115 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-933f34f9-ac03-49a4-b2dd-58ae8f7517d7 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:38.119100 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-933f34f9-ac03-49a4-b2dd-58ae8f7517d7 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:38.132499 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-933f34f9-ac03-49a4-b2dd-58ae8f7517d7 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.289864 Aug 08 16:54:38.143407 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 200/401] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:37 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:38.736141 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d9ba4532-d267-4191-a7e3-3341e215180e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:38.737935 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d9ba4532-d267-4191-a7e3-3341e215180e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:38.758126 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9ba4532-d267-4191-a7e3-3341e215180e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:38.764901 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9ba4532-d267-4191-a7e3-3341e215180e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:38.765518 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9ba4532-d267-4191-a7e3-3341e215180e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:38.767038 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9ba4532-d267-4191-a7e3-3341e215180e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:38.767904 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9ba4532-d267-4191-a7e3-3341e215180e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:38.768615 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d9ba4532-d267-4191-a7e3-3341e215180e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:38.917326 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-73ef8b62-df8d-4947-926c-534cb56e6b37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:38.918232 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-73ef8b62-df8d-4947-926c-534cb56e6b37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:38.987118 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73ef8b62-df8d-4947-926c-534cb56e6b37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:39.000063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73ef8b62-df8d-4947-926c-534cb56e6b37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:39.000063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73ef8b62-df8d-4947-926c-534cb56e6b37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:39.000063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73ef8b62-df8d-4947-926c-534cb56e6b37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:39.000063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73ef8b62-df8d-4947-926c-534cb56e6b37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:39.007301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73ef8b62-df8d-4947-926c-534cb56e6b37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:39.210451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d9ba4532-d267-4191-a7e3-3341e215180e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:39.241932 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d9ba4532-d267-4191-a7e3-3341e215180e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:39.253171 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d9ba4532-d267-4191-a7e3-3341e215180e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:39.259001 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d9ba4532-d267-4191-a7e3-3341e215180e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1407 microversion: 2.20 time: 0.532773 Aug 08 16:54:39.263410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 202/402] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:38 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1407 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:39.268665 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-73ef8b62-df8d-4947-926c-534cb56e6b37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:39.280949 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-772f25f4-7e56-477d-85d8-4279bcb10c9b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Action: 'create', calling method: .version_select at 0x7f5016230ee0>, body: {"keypair": {"name": "tempest-keypair-638390926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAqY60p06FNgUfHAd6/jk9L5cF7m1IDUNQ35cv42yipu5fXM3pwn52Rog6ye8enO8KsSixoqCPDhP0gCel/3KijEtXd+J8geYS9DdTAW772F18AjOWEBmkqv4lnSCcQvg=="}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:39.288076 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-73ef8b62-df8d-4947-926c-534cb56e6b37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1511 microversion: 2.1 time: 0.383152 Aug 08 16:54:39.290083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 201/403] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:38 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1511 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:39.312258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c664fbfa-5419-442f-aad5-e207c82f828c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:39.314017 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c664fbfa-5419-442f-aad5-e207c82f828c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:39.322487 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c664fbfa-5419-442f-aad5-e207c82f828c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:39.323556 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c664fbfa-5419-442f-aad5-e207c82f828c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:39.324212 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c664fbfa-5419-442f-aad5-e207c82f828c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:39.325131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c664fbfa-5419-442f-aad5-e207c82f828c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:39.325602 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c664fbfa-5419-442f-aad5-e207c82f828c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:39.326031 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c664fbfa-5419-442f-aad5-e207c82f828c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:39.335741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-772f25f4-7e56-477d-85d8-4279bcb10c9b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for project b2063a114c1942cab80ae4b708be9ab2. Resources: {'key_pairs'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:54:39.341794 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-772f25f4-7e56-477d-85d8-4279bcb10c9b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for user fdb16e7edbe143e9b96325842896f04e and project b2063a114c1942cab80ae4b708be9ab2. Resources: {'key_pairs'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:54:39.497157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-772f25f4-7e56-477d-85d8-4279bcb10c9b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.226773 Aug 08 16:54:39.503024 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 203/404] 10.222.0.13 () {60 vars in 1159 bytes} [Mon Aug 8 16:54:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:54:39.609869 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c664fbfa-5419-442f-aad5-e207c82f828c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:39.628247 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c664fbfa-5419-442f-aad5-e207c82f828c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.328318 Aug 08 16:54:39.636188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 202/405] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:39 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:39.654779 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-e61fde0a-3f31-49af-91f9-30e9cadedf1a req-6b868343-56ad-47f0-b490-57b5bfd9874d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c162d1e6-28a1-4af7-a11f-8ac7b6912a35", "name": "network-vif-plugged", "status": "completed", "tag": "bfa4314e-54cb-4bcf-ad62-d4a047f3db20"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:39.671140 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e61fde0a-3f31-49af-91f9-30e9cadedf1a req-6b868343-56ad-47f0-b490-57b5bfd9874d service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:39.676295 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e61fde0a-3f31-49af-91f9-30e9cadedf1a req-6b868343-56ad-47f0-b490-57b5bfd9874d service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:39.676295 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e61fde0a-3f31-49af-91f9-30e9cadedf1a req-6b868343-56ad-47f0-b490-57b5bfd9874d service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:39.693694 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-e61fde0a-3f31-49af-91f9-30e9cadedf1a req-6b868343-56ad-47f0-b490-57b5bfd9874d service nova] Creating event network-vif-plugged:bfa4314e-54cb-4bcf-ad62-d4a047f3db20 for instance c162d1e6-28a1-4af7-a11f-8ac7b6912a35 on hv-cinder-85220 Aug 08 16:54:39.705090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-e61fde0a-3f31-49af-91f9-30e9cadedf1a req-6b868343-56ad-47f0-b490-57b5bfd9874d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052954 Aug 08 16:54:39.708615 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 204/406] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:54:40.288784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-77fac2a9-5b23-49f5-91b1-6333459fed97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:40.290171 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-77fac2a9-5b23-49f5-91b1-6333459fed97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:40.310526 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-77fac2a9-5b23-49f5-91b1-6333459fed97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:40.312823 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-77fac2a9-5b23-49f5-91b1-6333459fed97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:40.313899 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-77fac2a9-5b23-49f5-91b1-6333459fed97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:40.316286 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-77fac2a9-5b23-49f5-91b1-6333459fed97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:40.317320 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-77fac2a9-5b23-49f5-91b1-6333459fed97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:40.318160 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-77fac2a9-5b23-49f5-91b1-6333459fed97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:40.326544 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ba430af5-91e8-446e-9433-64bd3a75c385 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:40.329513 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ba430af5-91e8-446e-9433-64bd3a75c385 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:40.377134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ba430af5-91e8-446e-9433-64bd3a75c385 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:40.382783 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ba430af5-91e8-446e-9433-64bd3a75c385 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:40.383685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ba430af5-91e8-446e-9433-64bd3a75c385 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:40.384839 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ba430af5-91e8-446e-9433-64bd3a75c385 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:40.385567 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ba430af5-91e8-446e-9433-64bd3a75c385 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:40.386222 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ba430af5-91e8-446e-9433-64bd3a75c385 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:40.638301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-77fac2a9-5b23-49f5-91b1-6333459fed97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:40.659272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-77fac2a9-5b23-49f5-91b1-6333459fed97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:40.663614 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-77fac2a9-5b23-49f5-91b1-6333459fed97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:40.666729 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-77fac2a9-5b23-49f5-91b1-6333459fed97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1599 microversion: 2.20 time: 0.383046 Aug 08 16:54:40.687246 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 203/407] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:54:40 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1599 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:54:40.714116 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d8c57783-251e-4dd0-84e4-ab54cccfff6d tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:40.715893 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d8c57783-251e-4dd0-84e4-ab54cccfff6d tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:40.728505 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d8c57783-251e-4dd0-84e4-ab54cccfff6d tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:40.729837 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d8c57783-251e-4dd0-84e4-ab54cccfff6d tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:40.731004 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d8c57783-251e-4dd0-84e4-ab54cccfff6d tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:40.732679 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d8c57783-251e-4dd0-84e4-ab54cccfff6d tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:40.733867 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d8c57783-251e-4dd0-84e4-ab54cccfff6d tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:40.735173 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d8c57783-251e-4dd0-84e4-ab54cccfff6d tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:41.002087 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d8c57783-251e-4dd0-84e4-ab54cccfff6d tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:41.010938 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d8c57783-251e-4dd0-84e4-ab54cccfff6d tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.321199 Aug 08 16:54:41.026688 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 204/408] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:40 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:41.032909 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1933efb2-6bd9-4ef5-a396-be46cb4678b0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:41.034073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1933efb2-6bd9-4ef5-a396-be46cb4678b0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:41.041061 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1933efb2-6bd9-4ef5-a396-be46cb4678b0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:41.042159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1933efb2-6bd9-4ef5-a396-be46cb4678b0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:41.042874 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1933efb2-6bd9-4ef5-a396-be46cb4678b0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:41.043885 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1933efb2-6bd9-4ef5-a396-be46cb4678b0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:41.044623 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1933efb2-6bd9-4ef5-a396-be46cb4678b0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:41.045328 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1933efb2-6bd9-4ef5-a396-be46cb4678b0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:41.116529 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ba430af5-91e8-446e-9433-64bd3a75c385 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:41.153219 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ba430af5-91e8-446e-9433-64bd3a75c385 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1511 microversion: 2.1 time: 0.829146 Aug 08 16:54:41.172257 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 205/409] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:40 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1511 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:41.187145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1933efb2-6bd9-4ef5-a396-be46cb4678b0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.153499 Aug 08 16:54:41.187145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 205/410] 10.222.0.13 () {60 vars in 1316 bytes} [Mon Aug 8 16:54:41 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:54:42.070149 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ab971c29-fd04-41b6-a088-1ebfc729ad60 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:42.087607 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ab971c29-fd04-41b6-a088-1ebfc729ad60 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:42.139605 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab971c29-fd04-41b6-a088-1ebfc729ad60 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:42.140557 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab971c29-fd04-41b6-a088-1ebfc729ad60 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:42.141962 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab971c29-fd04-41b6-a088-1ebfc729ad60 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:42.143387 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab971c29-fd04-41b6-a088-1ebfc729ad60 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:42.144114 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab971c29-fd04-41b6-a088-1ebfc729ad60 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:42.144963 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab971c29-fd04-41b6-a088-1ebfc729ad60 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:42.224674 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1bbdc1b3-54b3-4a0d-a83f-6cadc07afd18 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:42.226221 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1bbdc1b3-54b3-4a0d-a83f-6cadc07afd18 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:42.239815 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1bbdc1b3-54b3-4a0d-a83f-6cadc07afd18 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:42.240734 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1bbdc1b3-54b3-4a0d-a83f-6cadc07afd18 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:42.241591 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1bbdc1b3-54b3-4a0d-a83f-6cadc07afd18 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:42.243078 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1bbdc1b3-54b3-4a0d-a83f-6cadc07afd18 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:42.243987 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1bbdc1b3-54b3-4a0d-a83f-6cadc07afd18 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:42.244788 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1bbdc1b3-54b3-4a0d-a83f-6cadc07afd18 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:42.801534 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ab971c29-fd04-41b6-a088-1ebfc729ad60 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:42.814086 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ab971c29-fd04-41b6-a088-1ebfc729ad60 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.768688 Aug 08 16:54:42.827039 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 206/411] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:42 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:43.095109 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1bbdc1b3-54b3-4a0d-a83f-6cadc07afd18 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:43.110124 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1bbdc1b3-54b3-4a0d-a83f-6cadc07afd18 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1511 microversion: 2.1 time: 0.891074 Aug 08 16:54:43.115851 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 206/412] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:42 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1511 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:43.839738 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-969d1e2d-6563-4672-ba52-a38aa1c1d8f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:43.842313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-969d1e2d-6563-4672-ba52-a38aa1c1d8f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:43.852378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-969d1e2d-6563-4672-ba52-a38aa1c1d8f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:43.852867 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-969d1e2d-6563-4672-ba52-a38aa1c1d8f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:43.863385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-969d1e2d-6563-4672-ba52-a38aa1c1d8f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:43.869125 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-969d1e2d-6563-4672-ba52-a38aa1c1d8f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:43.870997 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-969d1e2d-6563-4672-ba52-a38aa1c1d8f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:43.871840 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-969d1e2d-6563-4672-ba52-a38aa1c1d8f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:43.894101 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:44.135983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6b26190c-7595-4ecc-b5a2-d4a8a59f4ad7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:44.137364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6b26190c-7595-4ecc-b5a2-d4a8a59f4ad7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:44.153431 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b26190c-7595-4ecc-b5a2-d4a8a59f4ad7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:44.154366 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b26190c-7595-4ecc-b5a2-d4a8a59f4ad7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:44.155076 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b26190c-7595-4ecc-b5a2-d4a8a59f4ad7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:44.156270 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b26190c-7595-4ecc-b5a2-d4a8a59f4ad7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:44.161059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b26190c-7595-4ecc-b5a2-d4a8a59f4ad7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:44.161818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b26190c-7595-4ecc-b5a2-d4a8a59f4ad7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:44.279599 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-969d1e2d-6563-4672-ba52-a38aa1c1d8f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:44.297331 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-969d1e2d-6563-4672-ba52-a38aa1c1d8f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.461330 Aug 08 16:54:44.305716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 207/413] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:43 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:44.817309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6b26190c-7595-4ecc-b5a2-d4a8a59f4ad7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:44.824706 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-8df11ca4-e0f7-4c37-86e3-655086f14122 req-ca536a3b-ba8b-4841-be54-ee6034b8baed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70c7402-29f3-48b0-b5fc-dd586f6e4266", "tag": "ee6f4872-65bc-467b-9551-24824a3b32ad"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:44.831070 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6b26190c-7595-4ecc-b5a2-d4a8a59f4ad7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1517 microversion: 2.1 time: 0.698930 Aug 08 16:54:44.834354 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 207/414] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:44 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1517 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:44.873710 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-8df11ca4-e0f7-4c37-86e3-655086f14122 req-ca536a3b-ba8b-4841-be54-ee6034b8baed service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:44.874301 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-8df11ca4-e0f7-4c37-86e3-655086f14122 req-ca536a3b-ba8b-4841-be54-ee6034b8baed service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:44.881295 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-8df11ca4-e0f7-4c37-86e3-655086f14122 req-ca536a3b-ba8b-4841-be54-ee6034b8baed service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:44.911480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-8df11ca4-e0f7-4c37-86e3-655086f14122 req-ca536a3b-ba8b-4841-be54-ee6034b8baed service nova] Creating event network-changed:ee6f4872-65bc-467b-9551-24824a3b32ad for instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 on hv-cinder-85220 Aug 08 16:54:44.938742 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-8df11ca4-e0f7-4c37-86e3-655086f14122 req-ca536a3b-ba8b-4841-be54-ee6034b8baed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098214 Aug 08 16:54:44.940134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 208/415] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:54:45.327596 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4885fd2a-88ec-46c1-9967-276a709c7b6e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:45.329396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4885fd2a-88ec-46c1-9967-276a709c7b6e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:45.350323 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4885fd2a-88ec-46c1-9967-276a709c7b6e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:45.359613 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4885fd2a-88ec-46c1-9967-276a709c7b6e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:45.366388 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4885fd2a-88ec-46c1-9967-276a709c7b6e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:45.371248 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4885fd2a-88ec-46c1-9967-276a709c7b6e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:45.373695 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4885fd2a-88ec-46c1-9967-276a709c7b6e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:45.374655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4885fd2a-88ec-46c1-9967-276a709c7b6e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:45.868419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4885fd2a-88ec-46c1-9967-276a709c7b6e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:45.887182 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4885fd2a-88ec-46c1-9967-276a709c7b6e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1319 microversion: 2.1 time: 0.570442 Aug 08 16:54:45.892658 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 208/416] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:45 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1319 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:46.179437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-681888027", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13e31057-f543-4337-919e-432a457bba76"}], "security_groups": [{"name": "tempest-securitygroup--168339883"}], "key_name": "tempest-keypair-638390926", "user_data": "}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:46.499148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.network.neutron [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] validate_networks() for [('13e31057-f543-4337-919e-432a457bba76', None, None, None, None, None)] {{(pid=130235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:54:46.911868 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-be1bfcd0-d9ea-4c33-a56e-47380364db76 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:46.912563 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-be1bfcd0-d9ea-4c33-a56e-47380364db76 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:46.927314 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-be1bfcd0-d9ea-4c33-a56e-47380364db76 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:46.932351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-be1bfcd0-d9ea-4c33-a56e-47380364db76 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:46.932351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-be1bfcd0-d9ea-4c33-a56e-47380364db76 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:46.932351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-be1bfcd0-d9ea-4c33-a56e-47380364db76 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:46.932351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-be1bfcd0-d9ea-4c33-a56e-47380364db76 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:46.947773 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-be1bfcd0-d9ea-4c33-a56e-47380364db76 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:47.483447 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-be1bfcd0-d9ea-4c33-a56e-47380364db76 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:47.493093 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-be1bfcd0-d9ea-4c33-a56e-47380364db76 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1509 microversion: 2.1 time: 0.587211 Aug 08 16:54:47.493723 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 209/417] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:46 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1509 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:47.525994 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f7f54b1c-36a5-4dca-aff2-3658cce23c1f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Action: 'create', calling method: .version_select at 0x7f5016217670>, body: {"keypair": {"name": "tempest-keypair-281708243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9SZ427G3mvPeijRFwgDa8rcny/R28u/t1RjKUbzBo4pgJBRi2lgrwKGG70cs5shqY732wyG7BYi9WaSeNs6AoiVI5/d+0CNvFDMuBbZmApTdPObGrrKD4Tu428+hLOYQ=="}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:47.563470 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-f7f54b1c-36a5-4dca-aff2-3658cce23c1f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Getting quotas for project 6cac5ca5a8b04bce9a9d8ac938cd35e8. Resources: {'key_pairs'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:54:47.568443 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-f7f54b1c-36a5-4dca-aff2-3658cce23c1f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Getting quotas for user 75d793a42ec74232899b7a19e36b5867 and project 6cac5ca5a8b04bce9a9d8ac938cd35e8. Resources: {'key_pairs'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:54:47.703563 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f7f54b1c-36a5-4dca-aff2-3658cce23c1f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.203268 Aug 08 16:54:47.706756 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 210/418] 10.222.0.13 () {60 vars in 1159 bytes} [Mon Aug 8 16:54:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:54:47.905856 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Flavor limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:54:47.906344 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Image limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:54:47.907220 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Flavor pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:54:47.907709 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Image pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:54:47.908795 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:54:47.963187 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:47.963728 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:47.964190 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:47.965019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:47.965487 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:47.965921 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:48.059171 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for project b2063a114c1942cab80ae4b708be9ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:54:48.068868 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for user fdb16e7edbe143e9b96325842896f04e and project b2063a114c1942cab80ae4b708be9ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:54:48.107814 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Going to run 1 instances... {{(pid=130235) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:54:48.112513 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:54:48.330317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-6bf09387-7adb-42aa-b6c9-b2c9f1857efb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.160814 Aug 08 16:54:48.338491 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 209/419] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:54:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 16:54:48.358461 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e02f890e-5386-46f3-b0cb-bbc17e678331 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:48.359181 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e02f890e-5386-46f3-b0cb-bbc17e678331 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:48.669870 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e02f890e-5386-46f3-b0cb-bbc17e678331 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:48.686546 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e02f890e-5386-46f3-b0cb-bbc17e678331 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1240 microversion: 2.1 time: 0.340409 Aug 08 16:54:48.729885 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-76e5ad35-2278-495a-a562-2e7957d9ee7b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:48.738112 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 211/420] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:48 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1240 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:48.802106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76e5ad35-2278-495a-a562-2e7957d9ee7b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:48.818056 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76e5ad35-2278-495a-a562-2e7957d9ee7b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:48.825312 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76e5ad35-2278-495a-a562-2e7957d9ee7b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:48.940898 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-76e5ad35-2278-495a-a562-2e7957d9ee7b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Going to try to stop instance {{(pid=130235) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 16:54:49.281175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-76e5ad35-2278-495a-a562-2e7957d9ee7b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "POST /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/action" status: 202 len: 0 microversion: 2.1 time: 0.590661 Aug 08 16:54:49.281917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 210/421] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 16:54:48 2022] POST /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:54:49.316562 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f374990c-cbab-4189-b79c-a5763ecdd8f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:49.320164 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f374990c-cbab-4189-b79c-a5763ecdd8f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:49.333747 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f374990c-cbab-4189-b79c-a5763ecdd8f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:49.336447 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f374990c-cbab-4189-b79c-a5763ecdd8f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:49.337288 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f374990c-cbab-4189-b79c-a5763ecdd8f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:49.340565 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f374990c-cbab-4189-b79c-a5763ecdd8f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:49.341591 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f374990c-cbab-4189-b79c-a5763ecdd8f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:49.342293 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f374990c-cbab-4189-b79c-a5763ecdd8f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:49.775549 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-754fe0cf-35ff-4ee4-ada4-bd14f0b8d14f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:49.776684 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-754fe0cf-35ff-4ee4-ada4-bd14f0b8d14f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:49.813910 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f374990c-cbab-4189-b79c-a5763ecdd8f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:49.851201 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f374990c-cbab-4189-b79c-a5763ecdd8f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.559874 Aug 08 16:54:49.867105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 212/422] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:49 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:49.959364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-754fe0cf-35ff-4ee4-ada4-bd14f0b8d14f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:49.967951 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-754fe0cf-35ff-4ee4-ada4-bd14f0b8d14f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1240 microversion: 2.1 time: 0.199345 Aug 08 16:54:49.970185 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 211/423] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:49 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1240 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:50.875216 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fc163191-689f-4b93-bdd7-58654a8a5bbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:50.876172 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fc163191-689f-4b93-bdd7-58654a8a5bbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:50.892743 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fc163191-689f-4b93-bdd7-58654a8a5bbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:50.893496 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fc163191-689f-4b93-bdd7-58654a8a5bbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:50.897744 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fc163191-689f-4b93-bdd7-58654a8a5bbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:50.897744 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fc163191-689f-4b93-bdd7-58654a8a5bbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:50.897744 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fc163191-689f-4b93-bdd7-58654a8a5bbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:50.897744 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fc163191-689f-4b93-bdd7-58654a8a5bbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:51.009766 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-767e01b5-237d-4841-a144-b645d35b3292 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:51.011122 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-767e01b5-237d-4841-a144-b645d35b3292 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:51.026243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-767e01b5-237d-4841-a144-b645d35b3292 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:51.028017 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-767e01b5-237d-4841-a144-b645d35b3292 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:51.029721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-767e01b5-237d-4841-a144-b645d35b3292 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:51.032666 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-767e01b5-237d-4841-a144-b645d35b3292 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:51.035180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-767e01b5-237d-4841-a144-b645d35b3292 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:51.037185 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-767e01b5-237d-4841-a144-b645d35b3292 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:51.222485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-767e01b5-237d-4841-a144-b645d35b3292 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:51.233862 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-767e01b5-237d-4841-a144-b645d35b3292 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1236 microversion: 2.1 time: 0.229284 Aug 08 16:54:51.240106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 212/424] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:51 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1236 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:51.412468 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fc163191-689f-4b93-bdd7-58654a8a5bbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:51.419586 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=100 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:51.423244 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fc163191-689f-4b93-bdd7-58654a8a5bbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.552000 Aug 08 16:54:51.425836 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 213/425] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:50 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:52.280138 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0d8a7c7a-7ac1-4525-b8dc-5cd0420482f4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:52.288617 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0d8a7c7a-7ac1-4525-b8dc-5cd0420482f4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:52.385482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0d8a7c7a-7ac1-4525-b8dc-5cd0420482f4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:52.391514 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0d8a7c7a-7ac1-4525-b8dc-5cd0420482f4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:52.407216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0d8a7c7a-7ac1-4525-b8dc-5cd0420482f4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:52.412371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0d8a7c7a-7ac1-4525-b8dc-5cd0420482f4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:52.413653 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0d8a7c7a-7ac1-4525-b8dc-5cd0420482f4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:52.415599 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0d8a7c7a-7ac1-4525-b8dc-5cd0420482f4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:52.485963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-403ae667-96cb-4d14-870c-6c8bdf35bee8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:52.491337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-403ae667-96cb-4d14-870c-6c8bdf35bee8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:52.512553 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-403ae667-96cb-4d14-870c-6c8bdf35bee8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:52.513818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-403ae667-96cb-4d14-870c-6c8bdf35bee8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:52.514875 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-403ae667-96cb-4d14-870c-6c8bdf35bee8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:52.517694 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-403ae667-96cb-4d14-870c-6c8bdf35bee8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:52.519117 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-403ae667-96cb-4d14-870c-6c8bdf35bee8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:52.520163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-403ae667-96cb-4d14-870c-6c8bdf35bee8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:52.620376 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0d8a7c7a-7ac1-4525-b8dc-5cd0420482f4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:52.638052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0d8a7c7a-7ac1-4525-b8dc-5cd0420482f4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1292 microversion: 2.1 time: 0.374816 Aug 08 16:54:52.638696 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 213/426] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:52 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1292 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:52.976095 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-403ae667-96cb-4d14-870c-6c8bdf35bee8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:52.991936 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-403ae667-96cb-4d14-870c-6c8bdf35bee8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.518615 Aug 08 16:54:52.994806 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 214/427] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:52 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:53.683439 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c1273297-e603-4c35-bafb-9e105788ed5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:53.685639 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c1273297-e603-4c35-bafb-9e105788ed5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:53.723767 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c1273297-e603-4c35-bafb-9e105788ed5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:53.724344 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c1273297-e603-4c35-bafb-9e105788ed5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:53.724842 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c1273297-e603-4c35-bafb-9e105788ed5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:53.725950 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c1273297-e603-4c35-bafb-9e105788ed5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:53.726444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c1273297-e603-4c35-bafb-9e105788ed5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:53.727150 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c1273297-e603-4c35-bafb-9e105788ed5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:54.050941 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b0f2f3dd-c402-4171-9adb-efd75bb492b9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:54.052409 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b0f2f3dd-c402-4171-9adb-efd75bb492b9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:54.061882 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0f2f3dd-c402-4171-9adb-efd75bb492b9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:54.063996 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0f2f3dd-c402-4171-9adb-efd75bb492b9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:54.064738 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0f2f3dd-c402-4171-9adb-efd75bb492b9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:54.066099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0f2f3dd-c402-4171-9adb-efd75bb492b9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:54.067032 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0f2f3dd-c402-4171-9adb-efd75bb492b9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:54.067676 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0f2f3dd-c402-4171-9adb-efd75bb492b9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:54.185782 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c1273297-e603-4c35-bafb-9e105788ed5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:54.212556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c1273297-e603-4c35-bafb-9e105788ed5a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1310 microversion: 2.1 time: 0.540761 Aug 08 16:54:54.225859 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 214/428] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:53 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1310 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:54.236250 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-357482366", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1eb484d-fc4e-424a-97e1-7a3cf0b73a68"}], "security_groups": [{"name": "tempest-securitygroup--1513684067"}], "key_name": "tempest-keypair-281708243", "user_data": "}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:54.464589 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b0f2f3dd-c402-4171-9adb-efd75bb492b9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:54.477454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b0f2f3dd-c402-4171-9adb-efd75bb492b9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.433317 Aug 08 16:54:54.478618 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 215/429] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:54 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:55.254934 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-679d3af9-e6bd-4132-b53d-15b31414386c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:55.256711 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-679d3af9-e6bd-4132-b53d-15b31414386c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:55.276861 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-679d3af9-e6bd-4132-b53d-15b31414386c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:55.277577 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-679d3af9-e6bd-4132-b53d-15b31414386c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:55.278044 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-679d3af9-e6bd-4132-b53d-15b31414386c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:55.279170 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-679d3af9-e6bd-4132-b53d-15b31414386c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:55.280272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-679d3af9-e6bd-4132-b53d-15b31414386c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:55.280876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-679d3af9-e6bd-4132-b53d-15b31414386c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:55.380799 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-679d3af9-e6bd-4132-b53d-15b31414386c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:55.391859 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-679d3af9-e6bd-4132-b53d-15b31414386c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1298 microversion: 2.1 time: 0.145006 Aug 08 16:54:55.393380 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 216/430] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:55 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:55.512614 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e39edff9-6ab3-4518-ae91-76798eab339d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:55.513288 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e39edff9-6ab3-4518-ae91-76798eab339d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:55.526090 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e39edff9-6ab3-4518-ae91-76798eab339d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:55.526722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e39edff9-6ab3-4518-ae91-76798eab339d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:55.527176 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e39edff9-6ab3-4518-ae91-76798eab339d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:55.527914 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e39edff9-6ab3-4518-ae91-76798eab339d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:55.528417 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e39edff9-6ab3-4518-ae91-76798eab339d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:55.528972 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e39edff9-6ab3-4518-ae91-76798eab339d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:56.056599 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e39edff9-6ab3-4518-ae91-76798eab339d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:56.075289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e39edff9-6ab3-4518-ae91-76798eab339d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.567053 Aug 08 16:54:56.075992 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 217/431] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:55 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:56.421891 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-dc62573f-8fb2-4cab-819f-5ac4e5c947fb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:56.426375 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-dc62573f-8fb2-4cab-819f-5ac4e5c947fb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:56.466098 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc62573f-8fb2-4cab-819f-5ac4e5c947fb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:56.467231 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc62573f-8fb2-4cab-819f-5ac4e5c947fb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:56.471486 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc62573f-8fb2-4cab-819f-5ac4e5c947fb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:56.474598 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc62573f-8fb2-4cab-819f-5ac4e5c947fb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:56.482802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc62573f-8fb2-4cab-819f-5ac4e5c947fb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:56.488085 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc62573f-8fb2-4cab-819f-5ac4e5c947fb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:57.044548 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-dc62573f-8fb2-4cab-819f-5ac4e5c947fb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:57.082335 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-dc62573f-8fb2-4cab-819f-5ac4e5c947fb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.668448 Aug 08 16:54:57.095699 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 218/432] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:56 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:57.138791 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c0670e67-1590-40a7-b60a-bd53dc6167f9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:57.144159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c0670e67-1590-40a7-b60a-bd53dc6167f9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:57.170408 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c0670e67-1590-40a7-b60a-bd53dc6167f9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:57.177162 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c0670e67-1590-40a7-b60a-bd53dc6167f9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:57.178667 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c0670e67-1590-40a7-b60a-bd53dc6167f9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:57.180481 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c0670e67-1590-40a7-b60a-bd53dc6167f9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:57.185134 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c0670e67-1590-40a7-b60a-bd53dc6167f9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:57.186346 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c0670e67-1590-40a7-b60a-bd53dc6167f9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:57.720655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c0670e67-1590-40a7-b60a-bd53dc6167f9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:57.745508 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c0670e67-1590-40a7-b60a-bd53dc6167f9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.626243 Aug 08 16:54:57.745508 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 219/433] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:57 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:54:58.016596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:58.152802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3aac462e-42ff-454b-95b8-bcb5200ed351 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:58.156817 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3aac462e-42ff-454b-95b8-bcb5200ed351 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:58.206841 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:58.210096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3aac462e-42ff-454b-95b8-bcb5200ed351 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:58.211324 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3aac462e-42ff-454b-95b8-bcb5200ed351 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:58.212148 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3aac462e-42ff-454b-95b8-bcb5200ed351 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:58.213535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3aac462e-42ff-454b-95b8-bcb5200ed351 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:58.214304 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3aac462e-42ff-454b-95b8-bcb5200ed351 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:58.216215 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3aac462e-42ff-454b-95b8-bcb5200ed351 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:58.656945 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3aac462e-42ff-454b-95b8-bcb5200ed351 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:58.690503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=6 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:54:58.706626 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3aac462e-42ff-454b-95b8-bcb5200ed351 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.576987 Aug 08 16:54:58.709843 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 220/434] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:58 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:58.743241 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-9ad9bad0-cfef-4543-ac9e-3aeeff0f74ec req-9af05839-39af-46f0-9a61-e6fbd8e8e4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cfbc416-d601-45f7-82e8-a6d09c30f448", "tag": "10a68390-2c05-4f51-b687-dc45d457b41d"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:54:58.816212 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-9ad9bad0-cfef-4543-ac9e-3aeeff0f74ec req-9af05839-39af-46f0-9a61-e6fbd8e8e4a4 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:58.819561 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-9ad9bad0-cfef-4543-ac9e-3aeeff0f74ec req-9af05839-39af-46f0-9a61-e6fbd8e8e4a4 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:58.824889 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-9ad9bad0-cfef-4543-ac9e-3aeeff0f74ec req-9af05839-39af-46f0-9a61-e6fbd8e8e4a4 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:58.852870 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-9ad9bad0-cfef-4543-ac9e-3aeeff0f74ec req-9af05839-39af-46f0-9a61-e6fbd8e8e4a4 service nova] Creating event network-changed:10a68390-2c05-4f51-b687-dc45d457b41d for instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 on hv-cinder-85220 Aug 08 16:54:58.859826 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-9ad9bad0-cfef-4543-ac9e-3aeeff0f74ec req-9af05839-39af-46f0-9a61-e6fbd8e8e4a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143057 Aug 08 16:54:58.861203 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 221/435] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:54:58.867904 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f316c6d7-47ac-4fe4-be13-2b09ad97f83d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:58.869059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f316c6d7-47ac-4fe4-be13-2b09ad97f83d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:58.881668 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f316c6d7-47ac-4fe4-be13-2b09ad97f83d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:58.882938 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f316c6d7-47ac-4fe4-be13-2b09ad97f83d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:58.883403 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f316c6d7-47ac-4fe4-be13-2b09ad97f83d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:58.884238 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f316c6d7-47ac-4fe4-be13-2b09ad97f83d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:58.884855 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f316c6d7-47ac-4fe4-be13-2b09ad97f83d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:58.887427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f316c6d7-47ac-4fe4-be13-2b09ad97f83d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:59.405730 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f316c6d7-47ac-4fe4-be13-2b09ad97f83d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:54:59.416844 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f316c6d7-47ac-4fe4-be13-2b09ad97f83d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.553728 Aug 08 16:54:59.417542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 222/436] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:58 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:54:59.742324 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5bc24cfc-08a1-4175-b5a9-43e933604348 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:54:59.743077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5bc24cfc-08a1-4175-b5a9-43e933604348 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:54:59.759886 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bc24cfc-08a1-4175-b5a9-43e933604348 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:59.773449 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bc24cfc-08a1-4175-b5a9-43e933604348 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:59.774884 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bc24cfc-08a1-4175-b5a9-43e933604348 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:59.775142 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bc24cfc-08a1-4175-b5a9-43e933604348 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:54:59.775758 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bc24cfc-08a1-4175-b5a9-43e933604348 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:54:59.776306 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5bc24cfc-08a1-4175-b5a9-43e933604348 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:54:59.967474 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=12 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:00.177134 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-5bc24cfc-08a1-4175-b5a9-43e933604348 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:00.244523 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5bc24cfc-08a1-4175-b5a9-43e933604348 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.482366 Aug 08 16:55:00.252544 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 223/437] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:54:59 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:00.468639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-125c55d6-c0d9-4e5b-ac44-1296ec268db5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:00.468639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-125c55d6-c0d9-4e5b-ac44-1296ec268db5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:00.493642 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-125c55d6-c0d9-4e5b-ac44-1296ec268db5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:00.497130 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-125c55d6-c0d9-4e5b-ac44-1296ec268db5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:00.497130 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-125c55d6-c0d9-4e5b-ac44-1296ec268db5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:00.501505 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-125c55d6-c0d9-4e5b-ac44-1296ec268db5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:00.502966 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-125c55d6-c0d9-4e5b-ac44-1296ec268db5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:00.504536 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-125c55d6-c0d9-4e5b-ac44-1296ec268db5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:00.990285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-125c55d6-c0d9-4e5b-ac44-1296ec268db5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:01.016298 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-125c55d6-c0d9-4e5b-ac44-1296ec268db5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.560488 Aug 08 16:55:01.016298 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 224/438] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:00 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:01.291078 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ab025f55-2ebb-4493-82b8-115a24fca1fa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:01.291995 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ab025f55-2ebb-4493-82b8-115a24fca1fa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:01.334291 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ab025f55-2ebb-4493-82b8-115a24fca1fa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:01.340074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ab025f55-2ebb-4493-82b8-115a24fca1fa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:01.340074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ab025f55-2ebb-4493-82b8-115a24fca1fa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:01.342042 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ab025f55-2ebb-4493-82b8-115a24fca1fa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:01.342865 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ab025f55-2ebb-4493-82b8-115a24fca1fa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:01.352025 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ab025f55-2ebb-4493-82b8-115a24fca1fa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:02.145687 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ab025f55-2ebb-4493-82b8-115a24fca1fa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:02.159443 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ab025f55-2ebb-4493-82b8-115a24fca1fa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.873896 Aug 08 16:55:02.160802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 225/439] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:01 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:02.183639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6b551552-cd3e-4818-a1bb-5605dc81c152 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:02.194791 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6b551552-cd3e-4818-a1bb-5605dc81c152 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:02.214264 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b551552-cd3e-4818-a1bb-5605dc81c152 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:02.219275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b551552-cd3e-4818-a1bb-5605dc81c152 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:02.220017 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b551552-cd3e-4818-a1bb-5605dc81c152 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:02.220829 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b551552-cd3e-4818-a1bb-5605dc81c152 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:02.221333 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b551552-cd3e-4818-a1bb-5605dc81c152 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:02.221812 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b551552-cd3e-4818-a1bb-5605dc81c152 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:02.506351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6b551552-cd3e-4818-a1bb-5605dc81c152 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:02.523273 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6b551552-cd3e-4818-a1bb-5605dc81c152 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.360178 Aug 08 16:55:02.523877 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 226/440] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:02 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:03.205714 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1fe263b7-3807-4480-a08f-86ce526d01dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:03.206900 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1fe263b7-3807-4480-a08f-86ce526d01dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:03.226077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1fe263b7-3807-4480-a08f-86ce526d01dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:03.227006 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1fe263b7-3807-4480-a08f-86ce526d01dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:03.227753 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1fe263b7-3807-4480-a08f-86ce526d01dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:03.229450 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1fe263b7-3807-4480-a08f-86ce526d01dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:03.230252 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1fe263b7-3807-4480-a08f-86ce526d01dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:03.231573 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1fe263b7-3807-4480-a08f-86ce526d01dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:03.468008 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1fe263b7-3807-4480-a08f-86ce526d01dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:03.485588 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1fe263b7-3807-4480-a08f-86ce526d01dd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.288709 Aug 08 16:55:03.486462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 227/441] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:03 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:03.554538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d7bdaf7c-7887-456b-b331-62dc7083fece tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:03.555838 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d7bdaf7c-7887-456b-b331-62dc7083fece tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:03.567577 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7bdaf7c-7887-456b-b331-62dc7083fece tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:03.568433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7bdaf7c-7887-456b-b331-62dc7083fece tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:03.569199 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7bdaf7c-7887-456b-b331-62dc7083fece tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:03.573738 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7bdaf7c-7887-456b-b331-62dc7083fece tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:03.573738 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7bdaf7c-7887-456b-b331-62dc7083fece tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:03.573738 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7bdaf7c-7887-456b-b331-62dc7083fece tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:03.829137 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d7bdaf7c-7887-456b-b331-62dc7083fece tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:03.877302 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d7bdaf7c-7887-456b-b331-62dc7083fece tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.327399 Aug 08 16:55:03.882664 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 228/442] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:03 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:04.198625 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:04.297860 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:04.540493 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d5d7a293-d72f-400b-9cb8-b9da705469c2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:04.550996 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d5d7a293-d72f-400b-9cb8-b9da705469c2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:04.596094 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d5d7a293-d72f-400b-9cb8-b9da705469c2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:04.600975 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d5d7a293-d72f-400b-9cb8-b9da705469c2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:04.601916 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d5d7a293-d72f-400b-9cb8-b9da705469c2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:04.602969 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d5d7a293-d72f-400b-9cb8-b9da705469c2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:04.603654 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d5d7a293-d72f-400b-9cb8-b9da705469c2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:04.604289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d5d7a293-d72f-400b-9cb8-b9da705469c2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:05.047038 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d5d7a293-d72f-400b-9cb8-b9da705469c2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:05.066801 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d5d7a293-d72f-400b-9cb8-b9da705469c2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.543346 Aug 08 16:55:05.069080 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 229/443] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:04 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:05.076551 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-531b31c4-5ee1-46f0-9fb5-40bcfe1830a4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:05.078389 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-531b31c4-5ee1-46f0-9fb5-40bcfe1830a4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:05.089627 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-531b31c4-5ee1-46f0-9fb5-40bcfe1830a4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:05.091493 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-531b31c4-5ee1-46f0-9fb5-40bcfe1830a4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:05.092294 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-531b31c4-5ee1-46f0-9fb5-40bcfe1830a4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:05.093346 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-531b31c4-5ee1-46f0-9fb5-40bcfe1830a4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:05.094943 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-531b31c4-5ee1-46f0-9fb5-40bcfe1830a4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:05.096158 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-531b31c4-5ee1-46f0-9fb5-40bcfe1830a4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:05.363355 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-531b31c4-5ee1-46f0-9fb5-40bcfe1830a4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:05.372963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-531b31c4-5ee1-46f0-9fb5-40bcfe1830a4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.302204 Aug 08 16:55:05.373544 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 230/444] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:05 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:06.090198 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1c45765d-9d26-4a1f-83c8-6914713efcb4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:06.092323 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1c45765d-9d26-4a1f-83c8-6914713efcb4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:06.110467 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1c45765d-9d26-4a1f-83c8-6914713efcb4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:06.113092 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1c45765d-9d26-4a1f-83c8-6914713efcb4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:06.114377 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1c45765d-9d26-4a1f-83c8-6914713efcb4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:06.120141 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1c45765d-9d26-4a1f-83c8-6914713efcb4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:06.121604 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1c45765d-9d26-4a1f-83c8-6914713efcb4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:06.122728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1c45765d-9d26-4a1f-83c8-6914713efcb4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:06.194393 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=100 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:06.487033 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1c45765d-9d26-4a1f-83c8-6914713efcb4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:06.496741 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1c45765d-9d26-4a1f-83c8-6914713efcb4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.411060 Aug 08 16:55:06.497964 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 231/445] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:06 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:06.519326 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5d3c5736-3f23-435e-9f78-34e2a683bb38 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:06.522687 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5d3c5736-3f23-435e-9f78-34e2a683bb38 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:06.528197 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5d3c5736-3f23-435e-9f78-34e2a683bb38 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:06.529180 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5d3c5736-3f23-435e-9f78-34e2a683bb38 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:06.529972 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5d3c5736-3f23-435e-9f78-34e2a683bb38 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:06.532023 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5d3c5736-3f23-435e-9f78-34e2a683bb38 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:06.533275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5d3c5736-3f23-435e-9f78-34e2a683bb38 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:06.534293 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5d3c5736-3f23-435e-9f78-34e2a683bb38 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:07.171828 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-5d3c5736-3f23-435e-9f78-34e2a683bb38 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:07.188712 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5d3c5736-3f23-435e-9f78-34e2a683bb38 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.680292 Aug 08 16:55:07.190861 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 232/446] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:06 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:07.547557 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a3ba98ac-157e-416d-af16-f4a3090791fc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:07.548218 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a3ba98ac-157e-416d-af16-f4a3090791fc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:07.555992 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a3ba98ac-157e-416d-af16-f4a3090791fc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:07.556765 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a3ba98ac-157e-416d-af16-f4a3090791fc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:07.557396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a3ba98ac-157e-416d-af16-f4a3090791fc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:07.558412 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a3ba98ac-157e-416d-af16-f4a3090791fc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:07.559077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a3ba98ac-157e-416d-af16-f4a3090791fc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:07.559709 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a3ba98ac-157e-416d-af16-f4a3090791fc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:07.980567 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a3ba98ac-157e-416d-af16-f4a3090791fc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:07.993337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a3ba98ac-157e-416d-af16-f4a3090791fc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.465976 Aug 08 16:55:07.995285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 233/447] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:07 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:08.236614 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-57410156-735b-49c7-b433-93a70901b33a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:08.237704 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-57410156-735b-49c7-b433-93a70901b33a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:08.259737 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-57410156-735b-49c7-b433-93a70901b33a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:08.260930 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-57410156-735b-49c7-b433-93a70901b33a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:08.261797 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-57410156-735b-49c7-b433-93a70901b33a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:08.263119 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-57410156-735b-49c7-b433-93a70901b33a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:08.264189 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-57410156-735b-49c7-b433-93a70901b33a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:08.265736 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-57410156-735b-49c7-b433-93a70901b33a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:09.251363 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-57410156-735b-49c7-b433-93a70901b33a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:09.264981 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-57410156-735b-49c7-b433-93a70901b33a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 1.035520 Aug 08 16:55:09.266337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 234/448] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:08 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:09.279003 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2ab5ef2e-19cd-4e97-a897-e3c07209f24e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:09.279003 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2ab5ef2e-19cd-4e97-a897-e3c07209f24e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:09.282289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2ab5ef2e-19cd-4e97-a897-e3c07209f24e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:09.282836 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2ab5ef2e-19cd-4e97-a897-e3c07209f24e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:09.283439 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2ab5ef2e-19cd-4e97-a897-e3c07209f24e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:09.284421 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2ab5ef2e-19cd-4e97-a897-e3c07209f24e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:09.285524 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2ab5ef2e-19cd-4e97-a897-e3c07209f24e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:09.286079 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2ab5ef2e-19cd-4e97-a897-e3c07209f24e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:09.586768 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2ab5ef2e-19cd-4e97-a897-e3c07209f24e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:09.600180 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2ab5ef2e-19cd-4e97-a897-e3c07209f24e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.332612 Aug 08 16:55:09.600890 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 235/449] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:09 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:10.305361 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a6eec451-6394-4336-b99f-72ac83772fb2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:10.305974 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a6eec451-6394-4336-b99f-72ac83772fb2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:10.314649 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6eec451-6394-4336-b99f-72ac83772fb2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:10.315513 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6eec451-6394-4336-b99f-72ac83772fb2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:10.316175 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6eec451-6394-4336-b99f-72ac83772fb2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:10.317108 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6eec451-6394-4336-b99f-72ac83772fb2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:10.317785 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6eec451-6394-4336-b99f-72ac83772fb2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:10.318390 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6eec451-6394-4336-b99f-72ac83772fb2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:10.579998 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a6eec451-6394-4336-b99f-72ac83772fb2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:10.627983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a6eec451-6394-4336-b99f-72ac83772fb2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.325717 Aug 08 16:55:10.642668 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 236/450] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:10 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:10.642668 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-16969da2-0f6e-4972-a45a-3d45ccbea251 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:10.643862 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-16969da2-0f6e-4972-a45a-3d45ccbea251 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:10.661011 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-16969da2-0f6e-4972-a45a-3d45ccbea251 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:10.662964 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-16969da2-0f6e-4972-a45a-3d45ccbea251 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:10.663887 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-16969da2-0f6e-4972-a45a-3d45ccbea251 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:10.665263 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-16969da2-0f6e-4972-a45a-3d45ccbea251 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:10.666712 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-16969da2-0f6e-4972-a45a-3d45ccbea251 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:10.668887 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-16969da2-0f6e-4972-a45a-3d45ccbea251 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:10.924084 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-16969da2-0f6e-4972-a45a-3d45ccbea251 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:10.952733 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-16969da2-0f6e-4972-a45a-3d45ccbea251 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.320961 Aug 08 16:55:10.954200 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 237/451] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:10 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:10.994749 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.network.neutron [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] validate_networks() for [('c1eb484d-fc4e-424a-97e1-7a3cf0b73a68', None, None, None, None, None)] {{(pid=130235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:55:11.625275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Flavor limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:55:11.628441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Image limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:55:11.630282 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Flavor pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:55:11.631917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Image pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:55:11.632699 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:55:11.657628 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:11.659074 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:11.659306 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-cce42c4d-e8b7-4f15-bfe4-e5160ac766b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:11.660241 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-cce42c4d-e8b7-4f15-bfe4-e5160ac766b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:11.663857 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:11.667343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:11.669268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:11.670131 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:11.694489 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cce42c4d-e8b7-4f15-bfe4-e5160ac766b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:11.694489 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cce42c4d-e8b7-4f15-bfe4-e5160ac766b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:11.714207 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cce42c4d-e8b7-4f15-bfe4-e5160ac766b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:11.715285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cce42c4d-e8b7-4f15-bfe4-e5160ac766b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:11.716006 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cce42c4d-e8b7-4f15-bfe4-e5160ac766b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:11.716596 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cce42c4d-e8b7-4f15-bfe4-e5160ac766b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:11.722481 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Getting quotas for project 6cac5ca5a8b04bce9a9d8ac938cd35e8. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:55:11.731760 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Getting quotas for user 75d793a42ec74232899b7a19e36b5867 and project 6cac5ca5a8b04bce9a9d8ac938cd35e8. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:55:11.757866 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Going to run 1 instances... {{(pid=130235) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:55:11.766803 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:55:12.005889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-366123f1-89a9-46d9-99da-e93bbc831566 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 17.778008 Aug 08 16:55:12.007045 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 215/452] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:54:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 17780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 16:55:12.032670 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2f16166a-67a9-44c6-b9df-b91e68852996 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:12.035651 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2f16166a-67a9-44c6-b9df-b91e68852996 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:12.073041 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f16166a-67a9-44c6-b9df-b91e68852996 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:12.073041 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f16166a-67a9-44c6-b9df-b91e68852996 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:12.073041 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f16166a-67a9-44c6-b9df-b91e68852996 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:12.100272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f16166a-67a9-44c6-b9df-b91e68852996 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:12.100272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f16166a-67a9-44c6-b9df-b91e68852996 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:12.100272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f16166a-67a9-44c6-b9df-b91e68852996 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:12.276027 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-cce42c4d-e8b7-4f15-bfe4-e5160ac766b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:12.287338 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-cce42c4d-e8b7-4f15-bfe4-e5160ac766b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.635056 Aug 08 16:55:12.299156 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 238/453] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:11 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:12.318284 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-13fe794c-9b90-4125-b742-735620bd97df tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:12.319864 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-13fe794c-9b90-4125-b742-735620bd97df tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:12.449634 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-13fe794c-9b90-4125-b742-735620bd97df tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:12.463654 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-13fe794c-9b90-4125-b742-735620bd97df tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1244 microversion: 2.1 time: 0.155707 Aug 08 16:55:12.482726 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 239/454] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:12 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1244 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:12.654894 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2f16166a-67a9-44c6-b9df-b91e68852996 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:12.683572 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2f16166a-67a9-44c6-b9df-b91e68852996 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.663490 Aug 08 16:55:12.684655 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 216/455] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:12 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:13.328607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6e4bfd63-8556-4a8d-93b0-ff70eb0bea8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:13.330691 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6e4bfd63-8556-4a8d-93b0-ff70eb0bea8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:13.348114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6e4bfd63-8556-4a8d-93b0-ff70eb0bea8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:13.349459 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6e4bfd63-8556-4a8d-93b0-ff70eb0bea8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:13.350522 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6e4bfd63-8556-4a8d-93b0-ff70eb0bea8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:13.352077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6e4bfd63-8556-4a8d-93b0-ff70eb0bea8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:13.353210 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6e4bfd63-8556-4a8d-93b0-ff70eb0bea8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:13.354266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6e4bfd63-8556-4a8d-93b0-ff70eb0bea8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:13.530238 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-24c517ea-ad4a-4afc-ac79-61cce53e1d52 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:13.537288 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-24c517ea-ad4a-4afc-ac79-61cce53e1d52 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:13.719999 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6e4bfd63-8556-4a8d-93b0-ff70eb0bea8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:13.732982 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-24c517ea-ad4a-4afc-ac79-61cce53e1d52 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:13.751902 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6e4bfd63-8556-4a8d-93b0-ff70eb0bea8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.431710 Aug 08 16:55:13.756920 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-24c517ea-ad4a-4afc-ac79-61cce53e1d52 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1244 microversion: 2.1 time: 0.254001 Aug 08 16:55:13.759225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 217/456] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:13 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1244 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:13.762512 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 240/457] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:13 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:13.798302 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6b073032-fafd-4f6e-9711-534db32f9cae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:13.817700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6b073032-fafd-4f6e-9711-534db32f9cae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:13.830794 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6b073032-fafd-4f6e-9711-534db32f9cae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:13.834982 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6b073032-fafd-4f6e-9711-534db32f9cae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:13.834982 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6b073032-fafd-4f6e-9711-534db32f9cae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:13.834982 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6b073032-fafd-4f6e-9711-534db32f9cae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:13.837700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6b073032-fafd-4f6e-9711-534db32f9cae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:13.839479 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6b073032-fafd-4f6e-9711-534db32f9cae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:14.197691 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-6b073032-fafd-4f6e-9711-534db32f9cae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:14.216834 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-6b073032-fafd-4f6e-9711-534db32f9cae tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.455332 Aug 08 16:55:14.218392 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 218/458] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:13 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:14.823187 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-89adadaa-50b0-4bd9-98d1-28d15200e342 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:14.833600 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-895277bf-d6ba-4cbb-bb64-02bde10add7d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:14.835305 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-895277bf-d6ba-4cbb-bb64-02bde10add7d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:14.836334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-89adadaa-50b0-4bd9-98d1-28d15200e342 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:14.890907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-895277bf-d6ba-4cbb-bb64-02bde10add7d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:14.891797 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-895277bf-d6ba-4cbb-bb64-02bde10add7d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:14.892623 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-895277bf-d6ba-4cbb-bb64-02bde10add7d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:14.893217 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-89adadaa-50b0-4bd9-98d1-28d15200e342 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:14.894553 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-895277bf-d6ba-4cbb-bb64-02bde10add7d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:14.895597 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-89adadaa-50b0-4bd9-98d1-28d15200e342 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:14.896535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-89adadaa-50b0-4bd9-98d1-28d15200e342 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:14.897454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-895277bf-d6ba-4cbb-bb64-02bde10add7d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:14.898782 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-89adadaa-50b0-4bd9-98d1-28d15200e342 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:14.899603 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-895277bf-d6ba-4cbb-bb64-02bde10add7d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:14.908424 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-89adadaa-50b0-4bd9-98d1-28d15200e342 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:14.909295 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-89adadaa-50b0-4bd9-98d1-28d15200e342 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:15.097461 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-895277bf-d6ba-4cbb-bb64-02bde10add7d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:15.115349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-895277bf-d6ba-4cbb-bb64-02bde10add7d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1240 microversion: 2.1 time: 0.288350 Aug 08 16:55:15.116525 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 219/459] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:14 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1240 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:15.248741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1fd0d81b-1687-41ae-967d-78a2925b1d1d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:15.255312 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1fd0d81b-1687-41ae-967d-78a2925b1d1d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:15.287091 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1fd0d81b-1687-41ae-967d-78a2925b1d1d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:15.288264 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1fd0d81b-1687-41ae-967d-78a2925b1d1d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:15.289605 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1fd0d81b-1687-41ae-967d-78a2925b1d1d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:15.293645 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1fd0d81b-1687-41ae-967d-78a2925b1d1d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:15.294968 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1fd0d81b-1687-41ae-967d-78a2925b1d1d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:15.297516 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1fd0d81b-1687-41ae-967d-78a2925b1d1d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:15.438243 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-89adadaa-50b0-4bd9-98d1-28d15200e342 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:15.478105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-89adadaa-50b0-4bd9-98d1-28d15200e342 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1724 microversion: 2.1 time: 0.663747 Aug 08 16:55:15.479123 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 241/460] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:14 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1724 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:15.854853 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1fd0d81b-1687-41ae-967d-78a2925b1d1d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:15.864888 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1fd0d81b-1687-41ae-967d-78a2925b1d1d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.625781 Aug 08 16:55:15.865488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 220/461] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:15 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:16.165971 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7213540b-b628-41e0-a195-1e70c9b0b7ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:16.166748 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7213540b-b628-41e0-a195-1e70c9b0b7ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:16.182742 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7213540b-b628-41e0-a195-1e70c9b0b7ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:16.183276 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7213540b-b628-41e0-a195-1e70c9b0b7ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:16.183721 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7213540b-b628-41e0-a195-1e70c9b0b7ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:16.184855 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7213540b-b628-41e0-a195-1e70c9b0b7ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:16.185322 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7213540b-b628-41e0-a195-1e70c9b0b7ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:16.188478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7213540b-b628-41e0-a195-1e70c9b0b7ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:16.525084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-86e7efbd-98ee-4a8e-b516-607aacd5a1dc tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:16.525956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-86e7efbd-98ee-4a8e-b516-607aacd5a1dc tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:16.569496 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-86e7efbd-98ee-4a8e-b516-607aacd5a1dc tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:16.575686 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-86e7efbd-98ee-4a8e-b516-607aacd5a1dc tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:16.578343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-86e7efbd-98ee-4a8e-b516-607aacd5a1dc tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:16.583931 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-86e7efbd-98ee-4a8e-b516-607aacd5a1dc tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:16.586903 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-86e7efbd-98ee-4a8e-b516-607aacd5a1dc tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:16.588987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-86e7efbd-98ee-4a8e-b516-607aacd5a1dc tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:16.649309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7213540b-b628-41e0-a195-1e70c9b0b7ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:16.699594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7213540b-b628-41e0-a195-1e70c9b0b7ca tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1296 microversion: 2.1 time: 0.537296 Aug 08 16:55:16.700679 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 242/462] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:16 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1296 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:16.910542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d0efc18f-f46e-43c1-80f7-1caca6d9b134 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:16.911726 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d0efc18f-f46e-43c1-80f7-1caca6d9b134 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:16.941689 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d0efc18f-f46e-43c1-80f7-1caca6d9b134 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:16.942596 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d0efc18f-f46e-43c1-80f7-1caca6d9b134 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:16.961433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d0efc18f-f46e-43c1-80f7-1caca6d9b134 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:16.961433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d0efc18f-f46e-43c1-80f7-1caca6d9b134 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:16.961433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d0efc18f-f46e-43c1-80f7-1caca6d9b134 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:16.961433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d0efc18f-f46e-43c1-80f7-1caca6d9b134 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:17.308357 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-86e7efbd-98ee-4a8e-b516-607aacd5a1dc tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:17.351858 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-86e7efbd-98ee-4a8e-b516-607aacd5a1dc tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1701 microversion: 2.1 time: 0.836522 Aug 08 16:55:17.396401 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 221/463] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:16 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1701 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:17.416205 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7564d9d8-08dc-4ea3-86c6-5e096dfa167a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:55:17.431387 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7564d9d8-08dc-4ea3-86c6-5e096dfa167a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:17.432692 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7564d9d8-08dc-4ea3-86c6-5e096dfa167a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:17.433957 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7564d9d8-08dc-4ea3-86c6-5e096dfa167a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:17.509160 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7564d9d8-08dc-4ea3-86c6-5e096dfa167a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Going to try to start instance {{(pid=130235) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 16:55:17.802495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d0efc18f-f46e-43c1-80f7-1caca6d9b134 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:17.830078 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d0efc18f-f46e-43c1-80f7-1caca6d9b134 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.927614 Aug 08 16:55:17.847773 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 243/464] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:16 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:17.864816 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ac70f0f6-607e-4965-ad87-c3104a8cfd7c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:17.866358 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ac70f0f6-607e-4965-ad87-c3104a8cfd7c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:17.877946 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac70f0f6-607e-4965-ad87-c3104a8cfd7c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:17.879247 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac70f0f6-607e-4965-ad87-c3104a8cfd7c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:17.880286 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac70f0f6-607e-4965-ad87-c3104a8cfd7c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:17.881827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac70f0f6-607e-4965-ad87-c3104a8cfd7c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:17.883279 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac70f0f6-607e-4965-ad87-c3104a8cfd7c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:17.884270 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac70f0f6-607e-4965-ad87-c3104a8cfd7c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:17.892353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7564d9d8-08dc-4ea3-86c6-5e096dfa167a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "POST /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/action" status: 202 len: 0 microversion: 2.1 time: 0.488406 Aug 08 16:55:17.893040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 222/465] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 16:55:17 2022] POST /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:55:17.906354 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-cccc7026-59a1-4abd-81f0-660ace9fdd05 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:17.918961 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-cccc7026-59a1-4abd-81f0-660ace9fdd05 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:17.944450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cccc7026-59a1-4abd-81f0-660ace9fdd05 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:17.949723 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cccc7026-59a1-4abd-81f0-660ace9fdd05 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:17.950384 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cccc7026-59a1-4abd-81f0-660ace9fdd05 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:17.951203 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cccc7026-59a1-4abd-81f0-660ace9fdd05 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:17.951681 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cccc7026-59a1-4abd-81f0-660ace9fdd05 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:17.952149 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cccc7026-59a1-4abd-81f0-660ace9fdd05 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:18.138326 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ac70f0f6-607e-4965-ad87-c3104a8cfd7c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:18.178929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ac70f0f6-607e-4965-ad87-c3104a8cfd7c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1302 microversion: 2.1 time: 0.328103 Aug 08 16:55:18.180870 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 244/466] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:17 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1302 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:18.226351 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-cccc7026-59a1-4abd-81f0-660ace9fdd05 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:18.239729 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-cccc7026-59a1-4abd-81f0-660ace9fdd05 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1710 microversion: 2.1 time: 0.336418 Aug 08 16:55:18.240796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 223/467] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:17 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1710 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:18.873178 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-96fe9367-5891-406d-bb04-527f7c09ff09 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:18.879102 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-96fe9367-5891-406d-bb04-527f7c09ff09 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:18.928901 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-96fe9367-5891-406d-bb04-527f7c09ff09 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:18.930963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-96fe9367-5891-406d-bb04-527f7c09ff09 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:18.965462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-96fe9367-5891-406d-bb04-527f7c09ff09 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:18.969845 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-96fe9367-5891-406d-bb04-527f7c09ff09 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:18.973815 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-96fe9367-5891-406d-bb04-527f7c09ff09 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:18.975563 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-96fe9367-5891-406d-bb04-527f7c09ff09 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:19.214321 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-965890c6-b968-494b-b30b-e97a04dadb69 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:19.216636 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-965890c6-b968-494b-b30b-e97a04dadb69 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:19.229638 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-965890c6-b968-494b-b30b-e97a04dadb69 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:19.234306 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-965890c6-b968-494b-b30b-e97a04dadb69 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:19.235619 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-965890c6-b968-494b-b30b-e97a04dadb69 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:19.237195 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-965890c6-b968-494b-b30b-e97a04dadb69 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:19.238289 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-965890c6-b968-494b-b30b-e97a04dadb69 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:19.239514 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-965890c6-b968-494b-b30b-e97a04dadb69 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:19.410441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-965890c6-b968-494b-b30b-e97a04dadb69 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:19.450027 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-965890c6-b968-494b-b30b-e97a04dadb69 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1302 microversion: 2.1 time: 0.248537 Aug 08 16:55:19.452186 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 224/468] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:19 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1302 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:19.508706 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-19ddb0a8-e4eb-486d-a1f2-251a81552529 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:19.512202 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-19ddb0a8-e4eb-486d-a1f2-251a81552529 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:19.570886 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-19ddb0a8-e4eb-486d-a1f2-251a81552529 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:19.572465 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-19ddb0a8-e4eb-486d-a1f2-251a81552529 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:19.574469 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-19ddb0a8-e4eb-486d-a1f2-251a81552529 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:19.576230 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-19ddb0a8-e4eb-486d-a1f2-251a81552529 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:19.577911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-19ddb0a8-e4eb-486d-a1f2-251a81552529 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:19.579477 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-19ddb0a8-e4eb-486d-a1f2-251a81552529 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:20.302200 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-19ddb0a8-e4eb-486d-a1f2-251a81552529 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:20.341632 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-19ddb0a8-e4eb-486d-a1f2-251a81552529 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1710 microversion: 2.1 time: 0.887394 Aug 08 16:55:20.374911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 225/469] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:19 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1710 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:20.383623 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-ab600e9e-2e6d-4522-9f17-b12479800462 req-3ee1e0f6-c754-4d39-aa13-c97552a6c653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cfbc416-d601-45f7-82e8-a6d09c30f448", "name": "network-vif-plugged", "status": "completed", "tag": "10a68390-2c05-4f51-b687-dc45d457b41d"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:55:20.425102 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-ab600e9e-2e6d-4522-9f17-b12479800462 req-3ee1e0f6-c754-4d39-aa13-c97552a6c653 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:20.426470 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-ab600e9e-2e6d-4522-9f17-b12479800462 req-3ee1e0f6-c754-4d39-aa13-c97552a6c653 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:20.432657 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-ab600e9e-2e6d-4522-9f17-b12479800462 req-3ee1e0f6-c754-4d39-aa13-c97552a6c653 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:20.463961 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-ab600e9e-2e6d-4522-9f17-b12479800462 req-3ee1e0f6-c754-4d39-aa13-c97552a6c653 service nova] Creating event network-vif-plugged:10a68390-2c05-4f51-b687-dc45d457b41d for instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 on hv-cinder-85220 Aug 08 16:55:20.480322 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-ab600e9e-2e6d-4522-9f17-b12479800462 req-3ee1e0f6-c754-4d39-aa13-c97552a6c653 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114887 Aug 08 16:55:20.483450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 226/470] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:55:20.511091 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-95024e4e-e5ce-4a3e-8af7-b87d2f17669f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:20.514003 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-95024e4e-e5ce-4a3e-8af7-b87d2f17669f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:20.531003 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-95024e4e-e5ce-4a3e-8af7-b87d2f17669f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:20.532443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-95024e4e-e5ce-4a3e-8af7-b87d2f17669f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:20.534887 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-95024e4e-e5ce-4a3e-8af7-b87d2f17669f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:20.536819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-95024e4e-e5ce-4a3e-8af7-b87d2f17669f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:20.538228 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-95024e4e-e5ce-4a3e-8af7-b87d2f17669f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:20.539361 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-95024e4e-e5ce-4a3e-8af7-b87d2f17669f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:20.725599 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-96fe9367-5891-406d-bb04-527f7c09ff09 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:20.743846 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-96fe9367-5891-406d-bb04-527f7c09ff09 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 1.878351 Aug 08 16:55:20.745720 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 245/471] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:18 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:20.871420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-95024e4e-e5ce-4a3e-8af7-b87d2f17669f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:20.893086 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-95024e4e-e5ce-4a3e-8af7-b87d2f17669f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1302 microversion: 2.1 time: 0.394315 Aug 08 16:55:20.894941 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 227/472] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:20 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1302 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:21.427639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d7677f33-09a6-4c88-8295-a8073d77c596 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:21.436896 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d7677f33-09a6-4c88-8295-a8073d77c596 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:21.500486 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7677f33-09a6-4c88-8295-a8073d77c596 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:21.501166 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7677f33-09a6-4c88-8295-a8073d77c596 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:21.509155 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7677f33-09a6-4c88-8295-a8073d77c596 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:21.516386 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7677f33-09a6-4c88-8295-a8073d77c596 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:21.520149 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7677f33-09a6-4c88-8295-a8073d77c596 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:21.521133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d7677f33-09a6-4c88-8295-a8073d77c596 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:21.788967 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-76f273ed-fe6b-42d3-849b-f24489f5a2a0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:21.794923 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-76f273ed-fe6b-42d3-849b-f24489f5a2a0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:21.821516 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:21.829620 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76f273ed-fe6b-42d3-849b-f24489f5a2a0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:21.839672 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76f273ed-fe6b-42d3-849b-f24489f5a2a0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:21.840328 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76f273ed-fe6b-42d3-849b-f24489f5a2a0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:21.846384 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76f273ed-fe6b-42d3-849b-f24489f5a2a0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:21.846384 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76f273ed-fe6b-42d3-849b-f24489f5a2a0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:21.846384 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76f273ed-fe6b-42d3-849b-f24489f5a2a0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:22.256372 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d7677f33-09a6-4c88-8295-a8073d77c596 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:22.298111 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d7677f33-09a6-4c88-8295-a8073d77c596 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1710 microversion: 2.1 time: 0.915412 Aug 08 16:55:22.303075 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 246/473] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:21 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1710 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:22.308615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4df3ddeb-e618-4796-8000-b5950642c0f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:22.310681 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4df3ddeb-e618-4796-8000-b5950642c0f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:22.317455 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4df3ddeb-e618-4796-8000-b5950642c0f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:22.318340 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4df3ddeb-e618-4796-8000-b5950642c0f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:22.319183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4df3ddeb-e618-4796-8000-b5950642c0f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:22.320265 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4df3ddeb-e618-4796-8000-b5950642c0f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:22.320988 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4df3ddeb-e618-4796-8000-b5950642c0f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:22.321942 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4df3ddeb-e618-4796-8000-b5950642c0f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:22.454985 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:22.837211 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-76f273ed-fe6b-42d3-849b-f24489f5a2a0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:22.872482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-76f273ed-fe6b-42d3-849b-f24489f5a2a0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 1.089441 Aug 08 16:55:22.874546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 228/474] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:21 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:22.896431 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-751b5c7c-6ea1-4822-aac8-c6831bed5840 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc08de0d-33df-4fe8-bf1b-45a02db2c8f0", "device": "/dev/sdb"}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:55:22.903671 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-751b5c7c-6ea1-4822-aac8-c6831bed5840 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:22.933492 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-751b5c7c-6ea1-4822-aac8-c6831bed5840 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:22.934367 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-751b5c7c-6ea1-4822-aac8-c6831bed5840 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:22.935192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-751b5c7c-6ea1-4822-aac8-c6831bed5840 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:22.937120 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-751b5c7c-6ea1-4822-aac8-c6831bed5840 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:22.937945 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-751b5c7c-6ea1-4822-aac8-c6831bed5840 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:22.943818 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-751b5c7c-6ea1-4822-aac8-c6831bed5840 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:23.046884 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4df3ddeb-e618-4796-8000-b5950642c0f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:23.084575 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4df3ddeb-e618-4796-8000-b5950642c0f8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1370 microversion: 2.1 time: 0.778525 Aug 08 16:55:23.100182 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 247/475] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:22 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1370 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:23.341072 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b0921cf5-0512-4a76-bb02-ab6cfa024dbf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:23.344898 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b0921cf5-0512-4a76-bb02-ab6cfa024dbf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:23.365415 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0921cf5-0512-4a76-bb02-ab6cfa024dbf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:23.366784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0921cf5-0512-4a76-bb02-ab6cfa024dbf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:23.368127 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0921cf5-0512-4a76-bb02-ab6cfa024dbf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:23.369593 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0921cf5-0512-4a76-bb02-ab6cfa024dbf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:23.370810 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0921cf5-0512-4a76-bb02-ab6cfa024dbf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:23.371872 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0921cf5-0512-4a76-bb02-ab6cfa024dbf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:23.777534 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=8 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:24.072910 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b0921cf5-0512-4a76-bb02-ab6cfa024dbf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:24.080779 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=100 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:24.089697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b0921cf5-0512-4a76-bb02-ab6cfa024dbf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1714 microversion: 2.1 time: 0.760432 Aug 08 16:55:24.099045 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 248/476] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:23 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1714 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:24.120045 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e3f44753-6e19-4ebc-86cc-e5523067da35 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:24.129521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e3f44753-6e19-4ebc-86cc-e5523067da35 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:24.163692 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3f44753-6e19-4ebc-86cc-e5523067da35 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:24.167573 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3f44753-6e19-4ebc-86cc-e5523067da35 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:24.173435 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3f44753-6e19-4ebc-86cc-e5523067da35 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:24.175270 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3f44753-6e19-4ebc-86cc-e5523067da35 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:24.175923 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3f44753-6e19-4ebc-86cc-e5523067da35 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:24.176534 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3f44753-6e19-4ebc-86cc-e5523067da35 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:24.512285 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-751b5c7c-6ea1-4822-aac8-c6831bed5840 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "POST /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.631934 Aug 08 16:55:24.534172 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 229/477] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 16:55:22 2022] POST /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35/os-volume_attachments => generated 194 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:55:24.562003 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f31d69e6-8bea-4f08-833d-d6bf3a9d7fba tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:24.571265 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f31d69e6-8bea-4f08-833d-d6bf3a9d7fba tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:24.579819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f31d69e6-8bea-4f08-833d-d6bf3a9d7fba tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:24.581083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f31d69e6-8bea-4f08-833d-d6bf3a9d7fba tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:24.583777 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f31d69e6-8bea-4f08-833d-d6bf3a9d7fba tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:24.587535 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f31d69e6-8bea-4f08-833d-d6bf3a9d7fba tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:24.590886 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f31d69e6-8bea-4f08-833d-d6bf3a9d7fba tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:24.593672 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f31d69e6-8bea-4f08-833d-d6bf3a9d7fba tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:24.911207 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e3f44753-6e19-4ebc-86cc-e5523067da35 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:24.940109 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e3f44753-6e19-4ebc-86cc-e5523067da35 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.839511 Aug 08 16:55:24.948136 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 249/478] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:24 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:25.141052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f31d69e6-8bea-4f08-833d-d6bf3a9d7fba tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:25.151437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f31d69e6-8bea-4f08-833d-d6bf3a9d7fba tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1370 microversion: 2.1 time: 0.610264 Aug 08 16:55:25.152246 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 230/479] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:24 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1370 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:25.542432 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-ff4bc207-79a9-409d-967d-109eb56dce2f req-981a52be-bb3c-4031-b03c-30de6ef1901e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af731dd6-88e0-49bd-b38b-3b629bf771bb", "tag": "9c64ef7c-063c-4f76-93a2-991e5526c905"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:55:25.576880 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-ff4bc207-79a9-409d-967d-109eb56dce2f req-981a52be-bb3c-4031-b03c-30de6ef1901e service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:25.578232 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-ff4bc207-79a9-409d-967d-109eb56dce2f req-981a52be-bb3c-4031-b03c-30de6ef1901e service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:25.579006 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-ff4bc207-79a9-409d-967d-109eb56dce2f req-981a52be-bb3c-4031-b03c-30de6ef1901e service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:25.617165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-ff4bc207-79a9-409d-967d-109eb56dce2f req-981a52be-bb3c-4031-b03c-30de6ef1901e service nova] Creating event network-changed:9c64ef7c-063c-4f76-93a2-991e5526c905 for instance af731dd6-88e0-49bd-b38b-3b629bf771bb on hv-cinder-85220 Aug 08 16:55:25.629111 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-ff4bc207-79a9-409d-967d-109eb56dce2f req-981a52be-bb3c-4031-b03c-30de6ef1901e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094537 Aug 08 16:55:25.631376 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 250/480] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:55:25.990159 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ff5d56bf-a348-441c-80fc-8185b549123e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:25.993021 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ff5d56bf-a348-441c-80fc-8185b549123e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:26.023707 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff5d56bf-a348-441c-80fc-8185b549123e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:26.034612 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff5d56bf-a348-441c-80fc-8185b549123e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:26.035717 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff5d56bf-a348-441c-80fc-8185b549123e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:26.040544 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff5d56bf-a348-441c-80fc-8185b549123e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:26.041586 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff5d56bf-a348-441c-80fc-8185b549123e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:26.042595 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff5d56bf-a348-441c-80fc-8185b549123e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:26.143278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:26.180885 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9b907219-1bf8-4798-9f89-ec72c49ad259 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:26.185201 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9b907219-1bf8-4798-9f89-ec72c49ad259 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:26.207809 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9b907219-1bf8-4798-9f89-ec72c49ad259 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:26.218680 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9b907219-1bf8-4798-9f89-ec72c49ad259 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:26.231984 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9b907219-1bf8-4798-9f89-ec72c49ad259 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:26.233936 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9b907219-1bf8-4798-9f89-ec72c49ad259 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:26.234881 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9b907219-1bf8-4798-9f89-ec72c49ad259 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:26.235717 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9b907219-1bf8-4798-9f89-ec72c49ad259 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:26.507274 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ff5d56bf-a348-441c-80fc-8185b549123e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:26.530961 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ff5d56bf-a348-441c-80fc-8185b549123e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1365 microversion: 2.1 time: 0.552120 Aug 08 16:55:26.540071 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 231/481] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:25 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1365 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:26.794795 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9b907219-1bf8-4798-9f89-ec72c49ad259 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:26.807861 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9b907219-1bf8-4798-9f89-ec72c49ad259 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1370 microversion: 2.1 time: 0.635254 Aug 08 16:55:26.814997 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 251/482] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:26 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1370 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:27.556172 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a7d7296a-1c6b-4d62-9baf-c24483285261 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:27.556958 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a7d7296a-1c6b-4d62-9baf-c24483285261 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:27.582844 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7d7296a-1c6b-4d62-9baf-c24483285261 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:27.582844 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7d7296a-1c6b-4d62-9baf-c24483285261 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:27.584118 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7d7296a-1c6b-4d62-9baf-c24483285261 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:27.584919 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7d7296a-1c6b-4d62-9baf-c24483285261 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:27.585384 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7d7296a-1c6b-4d62-9baf-c24483285261 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:27.587937 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7d7296a-1c6b-4d62-9baf-c24483285261 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:27.835155 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a7d7296a-1c6b-4d62-9baf-c24483285261 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:27.853094 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ffeee3e1-f501-460c-9728-73b40028ef19 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:27.862206 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ffeee3e1-f501-460c-9728-73b40028ef19 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:27.874324 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a7d7296a-1c6b-4d62-9baf-c24483285261 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1553 microversion: 2.1 time: 0.321991 Aug 08 16:55:27.877028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 232/483] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:27 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1553 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:27.883766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ffeee3e1-f501-460c-9728-73b40028ef19 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:27.885011 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ffeee3e1-f501-460c-9728-73b40028ef19 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:27.885993 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ffeee3e1-f501-460c-9728-73b40028ef19 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:27.887272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ffeee3e1-f501-460c-9728-73b40028ef19 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:27.888441 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ffeee3e1-f501-460c-9728-73b40028ef19 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:27.889233 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ffeee3e1-f501-460c-9728-73b40028ef19 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:27.905688 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-23299895-aaa9-4071-98d7-d638c78ed0b5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:27.906678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-23299895-aaa9-4071-98d7-d638c78ed0b5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:27.917415 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-23299895-aaa9-4071-98d7-d638c78ed0b5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:27.918548 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-23299895-aaa9-4071-98d7-d638c78ed0b5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:27.919635 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-23299895-aaa9-4071-98d7-d638c78ed0b5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:27.921824 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-23299895-aaa9-4071-98d7-d638c78ed0b5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:27.922960 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-23299895-aaa9-4071-98d7-d638c78ed0b5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:27.923914 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-23299895-aaa9-4071-98d7-d638c78ed0b5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:28.140417 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ffeee3e1-f501-460c-9728-73b40028ef19 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:28.150463 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ffeee3e1-f501-460c-9728-73b40028ef19 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1370 microversion: 2.1 time: 0.309088 Aug 08 16:55:28.151101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 252/484] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:27 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:28.160296 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-23299895-aaa9-4071-98d7-d638c78ed0b5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.262803 Aug 08 16:55:28.161190 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 233/485] 10.222.0.13 () {58 vars in 1275 bytes} [Mon Aug 8 16:55:27 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448/os-interface => generated 284 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:55:29.178098 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-47b829e2-b5d1-4be6-b5e7-ddcd3526e443 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:29.179055 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-47b829e2-b5d1-4be6-b5e7-ddcd3526e443 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:29.182037 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=68 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:29.193994 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-47b829e2-b5d1-4be6-b5e7-ddcd3526e443 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:29.194919 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-47b829e2-b5d1-4be6-b5e7-ddcd3526e443 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:29.198983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-47b829e2-b5d1-4be6-b5e7-ddcd3526e443 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:29.198983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-47b829e2-b5d1-4be6-b5e7-ddcd3526e443 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:29.198983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-47b829e2-b5d1-4be6-b5e7-ddcd3526e443 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:29.198983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-47b829e2-b5d1-4be6-b5e7-ddcd3526e443 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:29.440880 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-47b829e2-b5d1-4be6-b5e7-ddcd3526e443 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:29.453315 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-47b829e2-b5d1-4be6-b5e7-ddcd3526e443 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1370 microversion: 2.1 time: 0.280119 Aug 08 16:55:29.453914 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 253/486] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:29 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1370 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:30.293192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-6d1bdf71-9819-4424-9268-825f76b1e628 req-606b0bcc-e9f9-4663-b7f7-eeafe5886eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cfbc416-d601-45f7-82e8-a6d09c30f448", "tag": "10a68390-2c05-4f51-b687-dc45d457b41d"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:55:30.304368 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-6d1bdf71-9819-4424-9268-825f76b1e628 req-606b0bcc-e9f9-4663-b7f7-eeafe5886eab service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:30.305354 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-6d1bdf71-9819-4424-9268-825f76b1e628 req-606b0bcc-e9f9-4663-b7f7-eeafe5886eab service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:30.306199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-6d1bdf71-9819-4424-9268-825f76b1e628 req-606b0bcc-e9f9-4663-b7f7-eeafe5886eab service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:30.321218 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-6d1bdf71-9819-4424-9268-825f76b1e628 req-606b0bcc-e9f9-4663-b7f7-eeafe5886eab service nova] Creating event network-changed:10a68390-2c05-4f51-b687-dc45d457b41d for instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 on hv-cinder-85220 Aug 08 16:55:30.343901 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-6d1bdf71-9819-4424-9268-825f76b1e628 req-606b0bcc-e9f9-4663-b7f7-eeafe5886eab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037805 Aug 08 16:55:30.343901 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 234/487] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:55:30.476033 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-77798e48-5604-4bbe-88e1-d092f6fd1113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:30.477116 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-77798e48-5604-4bbe-88e1-d092f6fd1113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:30.491393 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-77798e48-5604-4bbe-88e1-d092f6fd1113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:30.492106 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-77798e48-5604-4bbe-88e1-d092f6fd1113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:30.492711 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-77798e48-5604-4bbe-88e1-d092f6fd1113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:30.494561 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-77798e48-5604-4bbe-88e1-d092f6fd1113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:30.495403 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-77798e48-5604-4bbe-88e1-d092f6fd1113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:30.496612 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-77798e48-5604-4bbe-88e1-d092f6fd1113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:30.754075 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-77798e48-5604-4bbe-88e1-d092f6fd1113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:30.769693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-77798e48-5604-4bbe-88e1-d092f6fd1113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1370 microversion: 2.1 time: 0.298063 Aug 08 16:55:30.771837 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 254/488] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:30 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1370 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:31.800759 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a8e52466-a7c7-40cf-8073-d43c65d4fbd4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:31.802368 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a8e52466-a7c7-40cf-8073-d43c65d4fbd4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:31.810811 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a8e52466-a7c7-40cf-8073-d43c65d4fbd4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:31.811555 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a8e52466-a7c7-40cf-8073-d43c65d4fbd4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:31.812076 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a8e52466-a7c7-40cf-8073-d43c65d4fbd4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:31.813270 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a8e52466-a7c7-40cf-8073-d43c65d4fbd4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:31.814011 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a8e52466-a7c7-40cf-8073-d43c65d4fbd4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:31.814676 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a8e52466-a7c7-40cf-8073-d43c65d4fbd4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:32.165981 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a8e52466-a7c7-40cf-8073-d43c65d4fbd4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:32.179404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a8e52466-a7c7-40cf-8073-d43c65d4fbd4 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1370 microversion: 2.1 time: 0.387710 Aug 08 16:55:32.180720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 235/489] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:31 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1370 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:33.230212 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-839c76ed-b361-4173-ad04-888324ade113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:33.237114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-839c76ed-b361-4173-ad04-888324ade113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:33.249920 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-839c76ed-b361-4173-ad04-888324ade113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:33.251219 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-839c76ed-b361-4173-ad04-888324ade113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:33.252287 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-839c76ed-b361-4173-ad04-888324ade113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:33.253345 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-839c76ed-b361-4173-ad04-888324ade113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:33.254142 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-839c76ed-b361-4173-ad04-888324ade113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:33.254866 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-839c76ed-b361-4173-ad04-888324ade113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:33.570617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-839c76ed-b361-4173-ad04-888324ade113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:33.583962 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-839c76ed-b361-4173-ad04-888324ade113 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1370 microversion: 2.1 time: 0.361217 Aug 08 16:55:33.584557 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 255/490] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:33 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:34.628096 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5f6ba3a4-02ec-4c75-bea3-0e389c674136 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:34.629445 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5f6ba3a4-02ec-4c75-bea3-0e389c674136 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:34.642288 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5f6ba3a4-02ec-4c75-bea3-0e389c674136 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:34.643215 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5f6ba3a4-02ec-4c75-bea3-0e389c674136 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:34.644017 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5f6ba3a4-02ec-4c75-bea3-0e389c674136 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:34.645313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5f6ba3a4-02ec-4c75-bea3-0e389c674136 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:34.646153 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5f6ba3a4-02ec-4c75-bea3-0e389c674136 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:34.646969 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5f6ba3a4-02ec-4c75-bea3-0e389c674136 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:34.849648 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5f6ba3a4-02ec-4c75-bea3-0e389c674136 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:34.858845 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5f6ba3a4-02ec-4c75-bea3-0e389c674136 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1370 microversion: 2.1 time: 0.238644 Aug 08 16:55:34.860124 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 236/491] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:34 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:34.973660 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-dbbd8936-51e3-4baf-8f5c-9483850ebbd0 req-f703c4b9-ed18-4af4-9476-19533349fa61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af731dd6-88e0-49bd-b38b-3b629bf771bb", "name": "network-vif-plugged", "status": "completed", "tag": "9c64ef7c-063c-4f76-93a2-991e5526c905"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:55:34.991225 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-dbbd8936-51e3-4baf-8f5c-9483850ebbd0 req-f703c4b9-ed18-4af4-9476-19533349fa61 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:34.992039 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-dbbd8936-51e3-4baf-8f5c-9483850ebbd0 req-f703c4b9-ed18-4af4-9476-19533349fa61 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:34.992835 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-dbbd8936-51e3-4baf-8f5c-9483850ebbd0 req-f703c4b9-ed18-4af4-9476-19533349fa61 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:35.016026 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-dbbd8936-51e3-4baf-8f5c-9483850ebbd0 req-f703c4b9-ed18-4af4-9476-19533349fa61 service nova] Creating event network-vif-plugged:9c64ef7c-063c-4f76-93a2-991e5526c905 for instance af731dd6-88e0-49bd-b38b-3b629bf771bb on hv-cinder-85220 Aug 08 16:55:35.027366 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-dbbd8936-51e3-4baf-8f5c-9483850ebbd0 req-f703c4b9-ed18-4af4-9476-19533349fa61 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072139 Aug 08 16:55:35.028518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 256/492] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:55:35.888214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fc5748eb-8b15-4a00-8a68-0af81449a387 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:35.889638 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fc5748eb-8b15-4a00-8a68-0af81449a387 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:35.895353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:35.902860 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fc5748eb-8b15-4a00-8a68-0af81449a387 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:35.904180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fc5748eb-8b15-4a00-8a68-0af81449a387 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:35.909467 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fc5748eb-8b15-4a00-8a68-0af81449a387 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:35.909467 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fc5748eb-8b15-4a00-8a68-0af81449a387 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:35.909467 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fc5748eb-8b15-4a00-8a68-0af81449a387 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:35.909467 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fc5748eb-8b15-4a00-8a68-0af81449a387 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:36.141322 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fc5748eb-8b15-4a00-8a68-0af81449a387 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:36.152668 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fc5748eb-8b15-4a00-8a68-0af81449a387 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1370 microversion: 2.1 time: 0.275167 Aug 08 16:55:36.153370 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 237/493] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:35 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:36.525973 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-bcba09ba-8a6a-4e1b-bae5-dfa34bb717ad tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Action: 'create', calling method: .version_select at 0x7f50161d7b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1177739294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQiRTCG8GU53SJ+E34lAL+JoRlVPHAp0r2TFQHwCmQYL96sYjF1zPiR2MQ0GaUn/Us3Kof82yfWQdClJvAxI0zqazgFxTosdXgr6nzHley1l2BDQ+hMCZp7htDVOxaN2Q=="}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:55:36.544332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-bcba09ba-8a6a-4e1b-bae5-dfa34bb717ad tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Getting quotas for project 236c710547184e33b1b14a88402fb363. Resources: {'key_pairs'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:55:36.549351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-bcba09ba-8a6a-4e1b-bae5-dfa34bb717ad tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Getting quotas for user fd667c5354f5499686dfe858bd159aa0 and project 236c710547184e33b1b14a88402fb363. Resources: {'key_pairs'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:55:36.646087 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-bcba09ba-8a6a-4e1b-bae5-dfa34bb717ad tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.123969 Aug 08 16:55:36.647337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 257/494] 10.222.0.13 () {60 vars in 1159 bytes} [Mon Aug 8 16:55:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:55:36.847530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-494285001", "imageRef": "ad182f26-b544-4c80-a9a9-2be6cadef5e2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1177739294", "networks": [{"uuid": "803e6272-bfaf-48b8-a85c-b33936c1913f"}]}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:55:36.918881 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.network.neutron [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] validate_networks() for [('803e6272-bfaf-48b8-a85c-b33936c1913f', None, None, None, None, None)] {{(pid=130235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:55:37.187872 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0670797c-ae55-46da-bf5a-09057ff0e06d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:37.189723 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0670797c-ae55-46da-bf5a-09057ff0e06d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:37.202789 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0670797c-ae55-46da-bf5a-09057ff0e06d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:37.204009 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0670797c-ae55-46da-bf5a-09057ff0e06d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:37.204781 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0670797c-ae55-46da-bf5a-09057ff0e06d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:37.205707 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0670797c-ae55-46da-bf5a-09057ff0e06d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:37.206355 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0670797c-ae55-46da-bf5a-09057ff0e06d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:37.206900 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0670797c-ae55-46da-bf5a-09057ff0e06d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:37.415131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0670797c-ae55-46da-bf5a-09057ff0e06d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:37.424956 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0670797c-ae55-46da-bf5a-09057ff0e06d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1370 microversion: 2.1 time: 0.251704 Aug 08 16:55:37.425641 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 258/495] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:37 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1370 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:37.454898 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Flavor limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:55:37.455367 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Image limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:55:37.455912 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Flavor pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:55:37.456360 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Image pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:55:37.456861 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:55:37.468481 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:37.469037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:37.469535 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:37.470313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:37.470868 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:37.471371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:37.491860 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Getting quotas for project 236c710547184e33b1b14a88402fb363. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:55:37.497202 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Getting quotas for user fd667c5354f5499686dfe858bd159aa0 and project 236c710547184e33b1b14a88402fb363. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:55:37.513009 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Going to run 1 instances... {{(pid=130235) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:55:37.516934 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad182f26-b544-4c80-a9a9-2be6cadef5e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:55:37.643814 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c51dbd04-cdf0-4ae5-9aa3-1813cdd9d72c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800689 Aug 08 16:55:37.644709 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 238/496] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:55:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 16:55:37.660688 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-666ba103-5a65-49ce-b1fc-7b2886d8fc8f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:37.661879 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-666ba103-5a65-49ce-b1fc-7b2886d8fc8f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:37.761839 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-666ba103-5a65-49ce-b1fc-7b2886d8fc8f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:37.786313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-666ba103-5a65-49ce-b1fc-7b2886d8fc8f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1258 microversion: 2.1 time: 0.131395 Aug 08 16:55:37.787544 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 259/497] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:37 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1258 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:38.458933 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-56bc9cc5-e38d-47fc-af61-e406608d2261 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:38.459852 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-56bc9cc5-e38d-47fc-af61-e406608d2261 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:38.466092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56bc9cc5-e38d-47fc-af61-e406608d2261 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:38.467453 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56bc9cc5-e38d-47fc-af61-e406608d2261 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:38.467453 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56bc9cc5-e38d-47fc-af61-e406608d2261 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:38.468107 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56bc9cc5-e38d-47fc-af61-e406608d2261 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:38.468575 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56bc9cc5-e38d-47fc-af61-e406608d2261 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:38.469009 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-56bc9cc5-e38d-47fc-af61-e406608d2261 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:38.625406 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-56bc9cc5-e38d-47fc-af61-e406608d2261 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:38.643367 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-56bc9cc5-e38d-47fc-af61-e406608d2261 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1370 microversion: 2.1 time: 0.189227 Aug 08 16:55:38.644113 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 239/498] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:38 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:38.818597 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-669350f7-dc95-4be7-86f5-288b6b15c8e9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:38.819757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-669350f7-dc95-4be7-86f5-288b6b15c8e9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:38.905720 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-669350f7-dc95-4be7-86f5-288b6b15c8e9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:38.914655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-669350f7-dc95-4be7-86f5-288b6b15c8e9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1258 microversion: 2.1 time: 0.103819 Aug 08 16:55:38.917086 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 260/499] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:38 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1258 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:39.666110 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f6964048-6717-4341-8936-8593a53e26b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:39.666973 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f6964048-6717-4341-8936-8593a53e26b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:39.674893 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f6964048-6717-4341-8936-8593a53e26b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:39.675386 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f6964048-6717-4341-8936-8593a53e26b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:39.675829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f6964048-6717-4341-8936-8593a53e26b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:39.676546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f6964048-6717-4341-8936-8593a53e26b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:39.677109 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f6964048-6717-4341-8936-8593a53e26b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:39.677417 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f6964048-6717-4341-8936-8593a53e26b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:39.869648 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f6964048-6717-4341-8936-8593a53e26b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:39.882175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f6964048-6717-4341-8936-8593a53e26b2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1565 microversion: 2.1 time: 0.220258 Aug 08 16:55:39.883043 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 240/500] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:39 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1565 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:39.905823 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f81a7ae2-16fd-4e71-81dd-df9175b8087d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:39.906780 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f81a7ae2-16fd-4e71-81dd-df9175b8087d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:39.913145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f81a7ae2-16fd-4e71-81dd-df9175b8087d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:39.913694 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f81a7ae2-16fd-4e71-81dd-df9175b8087d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:39.914167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f81a7ae2-16fd-4e71-81dd-df9175b8087d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:39.914992 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f81a7ae2-16fd-4e71-81dd-df9175b8087d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:39.915608 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f81a7ae2-16fd-4e71-81dd-df9175b8087d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:39.917285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f81a7ae2-16fd-4e71-81dd-df9175b8087d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:39.947812 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-647e5fd8-1127-40cc-9983-702f8dd2f985 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:39.948526 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-647e5fd8-1127-40cc-9983-702f8dd2f985 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:39.957734 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-647e5fd8-1127-40cc-9983-702f8dd2f985 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:39.958887 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-647e5fd8-1127-40cc-9983-702f8dd2f985 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:39.959677 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-647e5fd8-1127-40cc-9983-702f8dd2f985 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:39.961143 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-647e5fd8-1127-40cc-9983-702f8dd2f985 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:39.961947 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-647e5fd8-1127-40cc-9983-702f8dd2f985 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:39.962748 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-647e5fd8-1127-40cc-9983-702f8dd2f985 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:40.045952 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f81a7ae2-16fd-4e71-81dd-df9175b8087d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143883 Aug 08 16:55:40.046726 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 261/501] 10.222.0.13 () {58 vars in 1275 bytes} [Mon Aug 8 16:55:39 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:55:40.072637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-647e5fd8-1127-40cc-9983-702f8dd2f985 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:40.081926 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-647e5fd8-1127-40cc-9983-702f8dd2f985 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1262 microversion: 2.1 time: 0.139585 Aug 08 16:55:40.082517 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 241/502] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:39 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1262 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:41.105457 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-827a1f0e-82f4-4c13-bf96-bc5709c3b10a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:41.106500 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-827a1f0e-82f4-4c13-bf96-bc5709c3b10a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:41.115256 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-827a1f0e-82f4-4c13-bf96-bc5709c3b10a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:41.115901 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-827a1f0e-82f4-4c13-bf96-bc5709c3b10a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:41.116434 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-827a1f0e-82f4-4c13-bf96-bc5709c3b10a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:41.117530 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-827a1f0e-82f4-4c13-bf96-bc5709c3b10a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:41.118369 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-827a1f0e-82f4-4c13-bf96-bc5709c3b10a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:41.118919 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-827a1f0e-82f4-4c13-bf96-bc5709c3b10a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:41.222911 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-827a1f0e-82f4-4c13-bf96-bc5709c3b10a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:41.231150 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-827a1f0e-82f4-4c13-bf96-bc5709c3b10a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1262 microversion: 2.1 time: 0.130528 Aug 08 16:55:41.232464 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 262/503] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:41 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1262 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:41.633333 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-e7a4fb16-598e-4047-b62e-97933da5fba8 req-ca965f24-3ed6-429a-9cc0-3f719ef97fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af731dd6-88e0-49bd-b38b-3b629bf771bb", "tag": "9c64ef7c-063c-4f76-93a2-991e5526c905"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:55:41.649935 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e7a4fb16-598e-4047-b62e-97933da5fba8 req-ca965f24-3ed6-429a-9cc0-3f719ef97fb3 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:41.650800 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e7a4fb16-598e-4047-b62e-97933da5fba8 req-ca965f24-3ed6-429a-9cc0-3f719ef97fb3 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:41.651423 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e7a4fb16-598e-4047-b62e-97933da5fba8 req-ca965f24-3ed6-429a-9cc0-3f719ef97fb3 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:41.666507 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-e7a4fb16-598e-4047-b62e-97933da5fba8 req-ca965f24-3ed6-429a-9cc0-3f719ef97fb3 service nova] Creating event network-changed:9c64ef7c-063c-4f76-93a2-991e5526c905 for instance af731dd6-88e0-49bd-b38b-3b629bf771bb on hv-cinder-85220 Aug 08 16:55:41.674376 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-e7a4fb16-598e-4047-b62e-97933da5fba8 req-ca965f24-3ed6-429a-9cc0-3f719ef97fb3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044940 Aug 08 16:55:41.675669 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 242/504] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:55:42.259624 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3769a2bb-953f-4c71-bca4-c41933af1ad9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:42.261996 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3769a2bb-953f-4c71-bca4-c41933af1ad9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:42.274384 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3769a2bb-953f-4c71-bca4-c41933af1ad9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:42.275301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3769a2bb-953f-4c71-bca4-c41933af1ad9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:42.276082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3769a2bb-953f-4c71-bca4-c41933af1ad9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:42.277402 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3769a2bb-953f-4c71-bca4-c41933af1ad9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:42.278298 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3769a2bb-953f-4c71-bca4-c41933af1ad9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:42.280767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3769a2bb-953f-4c71-bca4-c41933af1ad9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:42.376413 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3769a2bb-953f-4c71-bca4-c41933af1ad9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:42.385819 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3769a2bb-953f-4c71-bca4-c41933af1ad9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1262 microversion: 2.1 time: 0.134819 Aug 08 16:55:42.386481 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 263/505] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:42 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1262 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:43.409231 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a82e76f4-1030-496c-ae45-7dcaa6cb852d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:43.410143 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a82e76f4-1030-496c-ae45-7dcaa6cb852d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:43.417025 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a82e76f4-1030-496c-ae45-7dcaa6cb852d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:43.417522 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a82e76f4-1030-496c-ae45-7dcaa6cb852d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:43.417963 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a82e76f4-1030-496c-ae45-7dcaa6cb852d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:43.418731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a82e76f4-1030-496c-ae45-7dcaa6cb852d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:43.419783 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a82e76f4-1030-496c-ae45-7dcaa6cb852d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:43.420357 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a82e76f4-1030-496c-ae45-7dcaa6cb852d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:43.491201 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a82e76f4-1030-496c-ae45-7dcaa6cb852d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:43.502033 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a82e76f4-1030-496c-ae45-7dcaa6cb852d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1262 microversion: 2.1 time: 0.097659 Aug 08 16:55:43.502648 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 243/506] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:43 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1262 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:44.524824 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0a919ba0-936c-4a67-a8ff-38322f8aa8d4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:44.525496 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0a919ba0-936c-4a67-a8ff-38322f8aa8d4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:44.533145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0a919ba0-936c-4a67-a8ff-38322f8aa8d4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:44.533645 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0a919ba0-936c-4a67-a8ff-38322f8aa8d4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:44.534085 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0a919ba0-936c-4a67-a8ff-38322f8aa8d4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:44.534843 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0a919ba0-936c-4a67-a8ff-38322f8aa8d4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:44.535606 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0a919ba0-936c-4a67-a8ff-38322f8aa8d4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:44.535850 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0a919ba0-936c-4a67-a8ff-38322f8aa8d4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:44.621226 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0a919ba0-936c-4a67-a8ff-38322f8aa8d4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:44.629906 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0a919ba0-936c-4a67-a8ff-38322f8aa8d4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1310 microversion: 2.1 time: 0.109599 Aug 08 16:55:44.630497 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 264/507] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:44 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1310 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:45.653264 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-891c91b6-31ad-41dd-9722-6f1a60bac01f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:45.654697 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-891c91b6-31ad-41dd-9722-6f1a60bac01f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:45.661971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-891c91b6-31ad-41dd-9722-6f1a60bac01f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:45.662476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-891c91b6-31ad-41dd-9722-6f1a60bac01f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:45.662959 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-891c91b6-31ad-41dd-9722-6f1a60bac01f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:45.663829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-891c91b6-31ad-41dd-9722-6f1a60bac01f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:45.664123 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-891c91b6-31ad-41dd-9722-6f1a60bac01f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:45.664554 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-891c91b6-31ad-41dd-9722-6f1a60bac01f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:45.764012 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-891c91b6-31ad-41dd-9722-6f1a60bac01f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:45.776772 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-891c91b6-31ad-41dd-9722-6f1a60bac01f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1328 microversion: 2.1 time: 0.127260 Aug 08 16:55:45.777796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 244/508] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:45 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1328 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:46.814639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-df97cf31-2677-4659-bfea-dd10b6804614 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:46.815373 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-df97cf31-2677-4659-bfea-dd10b6804614 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:46.822716 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-df97cf31-2677-4659-bfea-dd10b6804614 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:46.823200 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-df97cf31-2677-4659-bfea-dd10b6804614 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:46.823630 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-df97cf31-2677-4659-bfea-dd10b6804614 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:46.824329 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-df97cf31-2677-4659-bfea-dd10b6804614 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:46.824778 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-df97cf31-2677-4659-bfea-dd10b6804614 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:46.825198 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-df97cf31-2677-4659-bfea-dd10b6804614 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:47.010465 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-df97cf31-2677-4659-bfea-dd10b6804614 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:47.018989 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-df97cf31-2677-4659-bfea-dd10b6804614 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.208696 Aug 08 16:55:47.019595 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 265/509] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:46 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:48.040734 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9f1d6e80-81db-4ce4-be08-1557a561fb39 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:48.041604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9f1d6e80-81db-4ce4-be08-1557a561fb39 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:48.043918 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:48.045559 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=6 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:48.051053 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9f1d6e80-81db-4ce4-be08-1557a561fb39 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:48.051549 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9f1d6e80-81db-4ce4-be08-1557a561fb39 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:48.051993 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9f1d6e80-81db-4ce4-be08-1557a561fb39 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:48.052743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9f1d6e80-81db-4ce4-be08-1557a561fb39 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:48.053201 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9f1d6e80-81db-4ce4-be08-1557a561fb39 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:48.061023 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9f1d6e80-81db-4ce4-be08-1557a561fb39 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:48.227464 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9f1d6e80-81db-4ce4-be08-1557a561fb39 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:48.243571 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9f1d6e80-81db-4ce4-be08-1557a561fb39 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.206361 Aug 08 16:55:48.244670 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 245/510] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:48 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:49.269022 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f1ec8adf-e9cb-404c-aded-ff616c698df2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:49.269578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f1ec8adf-e9cb-404c-aded-ff616c698df2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:49.271724 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=8 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:49.277122 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f1ec8adf-e9cb-404c-aded-ff616c698df2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:49.277610 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f1ec8adf-e9cb-404c-aded-ff616c698df2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:49.278046 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f1ec8adf-e9cb-404c-aded-ff616c698df2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:49.279148 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f1ec8adf-e9cb-404c-aded-ff616c698df2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:49.280350 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f1ec8adf-e9cb-404c-aded-ff616c698df2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:49.280781 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f1ec8adf-e9cb-404c-aded-ff616c698df2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:49.433461 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f1ec8adf-e9cb-404c-aded-ff616c698df2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:49.442717 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f1ec8adf-e9cb-404c-aded-ff616c698df2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.178237 Aug 08 16:55:49.443313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 266/511] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:49 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:50.468150 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9f2b7f44-c04f-40a3-9f61-75209436f6a7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:50.469210 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9f2b7f44-c04f-40a3-9f61-75209436f6a7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:50.478821 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9f2b7f44-c04f-40a3-9f61-75209436f6a7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:50.479382 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9f2b7f44-c04f-40a3-9f61-75209436f6a7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:50.479929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9f2b7f44-c04f-40a3-9f61-75209436f6a7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:50.480828 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9f2b7f44-c04f-40a3-9f61-75209436f6a7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:50.481450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9f2b7f44-c04f-40a3-9f61-75209436f6a7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:50.481992 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9f2b7f44-c04f-40a3-9f61-75209436f6a7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:50.649693 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9f2b7f44-c04f-40a3-9f61-75209436f6a7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:50.658249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9f2b7f44-c04f-40a3-9f61-75209436f6a7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.197438 Aug 08 16:55:50.658899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 246/512] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:50 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:51.690068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-93676819-1e1d-4518-8d4f-7929e0595a29 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:51.691133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-93676819-1e1d-4518-8d4f-7929e0595a29 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:51.702718 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-93676819-1e1d-4518-8d4f-7929e0595a29 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:51.703491 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-93676819-1e1d-4518-8d4f-7929e0595a29 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:51.704200 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-93676819-1e1d-4518-8d4f-7929e0595a29 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:51.705393 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-93676819-1e1d-4518-8d4f-7929e0595a29 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:51.706133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-93676819-1e1d-4518-8d4f-7929e0595a29 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:51.706865 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-93676819-1e1d-4518-8d4f-7929e0595a29 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:51.925078 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-93676819-1e1d-4518-8d4f-7929e0595a29 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:51.941159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-93676819-1e1d-4518-8d4f-7929e0595a29 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.258250 Aug 08 16:55:51.942597 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 267/513] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:51 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:52.984018 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9fd103d0-b9cf-4447-a6ec-9405a255a176 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:52.985628 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9fd103d0-b9cf-4447-a6ec-9405a255a176 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:52.991440 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9fd103d0-b9cf-4447-a6ec-9405a255a176 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:52.991932 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9fd103d0-b9cf-4447-a6ec-9405a255a176 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:52.992420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9fd103d0-b9cf-4447-a6ec-9405a255a176 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:52.993146 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9fd103d0-b9cf-4447-a6ec-9405a255a176 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:52.993606 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9fd103d0-b9cf-4447-a6ec-9405a255a176 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:52.994035 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9fd103d0-b9cf-4447-a6ec-9405a255a176 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:53.199439 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9fd103d0-b9cf-4447-a6ec-9405a255a176 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:53.210226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9fd103d0-b9cf-4447-a6ec-9405a255a176 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.233991 Aug 08 16:55:53.211027 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 247/514] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:52 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:54.232538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-46c6962b-f4c3-4434-b149-6cd6c63f70be tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:54.233102 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-46c6962b-f4c3-4434-b149-6cd6c63f70be tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:54.240297 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-46c6962b-f4c3-4434-b149-6cd6c63f70be tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:54.240791 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-46c6962b-f4c3-4434-b149-6cd6c63f70be tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:54.241237 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-46c6962b-f4c3-4434-b149-6cd6c63f70be tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:54.241958 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-46c6962b-f4c3-4434-b149-6cd6c63f70be tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:54.242410 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-46c6962b-f4c3-4434-b149-6cd6c63f70be tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:54.242877 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-46c6962b-f4c3-4434-b149-6cd6c63f70be tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:54.399759 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-46c6962b-f4c3-4434-b149-6cd6c63f70be tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:54.413434 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-46c6962b-f4c3-4434-b149-6cd6c63f70be tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.184818 Aug 08 16:55:54.414454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 268/515] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:54 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:55.441208 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7156a1a6-2feb-45e1-aeeb-055dd47e158e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:55.442321 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7156a1a6-2feb-45e1-aeeb-055dd47e158e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:55.455554 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7156a1a6-2feb-45e1-aeeb-055dd47e158e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:55.456964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7156a1a6-2feb-45e1-aeeb-055dd47e158e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:55.457753 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7156a1a6-2feb-45e1-aeeb-055dd47e158e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:55.459114 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7156a1a6-2feb-45e1-aeeb-055dd47e158e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:55.460193 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7156a1a6-2feb-45e1-aeeb-055dd47e158e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:55.461199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7156a1a6-2feb-45e1-aeeb-055dd47e158e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:55.649174 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7156a1a6-2feb-45e1-aeeb-055dd47e158e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:55.659049 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7156a1a6-2feb-45e1-aeeb-055dd47e158e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.225561 Aug 08 16:55:55.659776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 248/516] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:55 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:56.687490 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-896c7ae7-27ba-4a57-9f30-8a5ea4eb0af9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:56.688405 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-896c7ae7-27ba-4a57-9f30-8a5ea4eb0af9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:56.701305 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-896c7ae7-27ba-4a57-9f30-8a5ea4eb0af9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:56.702056 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-896c7ae7-27ba-4a57-9f30-8a5ea4eb0af9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:56.702848 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-896c7ae7-27ba-4a57-9f30-8a5ea4eb0af9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:56.704096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-896c7ae7-27ba-4a57-9f30-8a5ea4eb0af9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:56.704898 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-896c7ae7-27ba-4a57-9f30-8a5ea4eb0af9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:56.705908 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-896c7ae7-27ba-4a57-9f30-8a5ea4eb0af9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:56.714030 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=93 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:56.960663 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-896c7ae7-27ba-4a57-9f30-8a5ea4eb0af9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:56.978549 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-896c7ae7-27ba-4a57-9f30-8a5ea4eb0af9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.299710 Aug 08 16:55:56.979641 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 269/517] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:56 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:55:58.009710 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-39c9a728-da40-4188-8028-4dec8aec38f5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:58.010512 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-39c9a728-da40-4188-8028-4dec8aec38f5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:58.018106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-39c9a728-da40-4188-8028-4dec8aec38f5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:58.018700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-39c9a728-da40-4188-8028-4dec8aec38f5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:58.019181 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-39c9a728-da40-4188-8028-4dec8aec38f5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:58.020178 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-39c9a728-da40-4188-8028-4dec8aec38f5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:58.020684 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-39c9a728-da40-4188-8028-4dec8aec38f5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:58.021162 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-39c9a728-da40-4188-8028-4dec8aec38f5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:58.024663 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=91 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:58.199794 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-39c9a728-da40-4188-8028-4dec8aec38f5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:58.208431 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-39c9a728-da40-4188-8028-4dec8aec38f5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.202847 Aug 08 16:55:58.209172 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 249/518] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:58 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:55:59.230879 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6a488ffe-aa4e-4ad0-93c7-c98bbf9aa026 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:55:59.231602 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6a488ffe-aa4e-4ad0-93c7-c98bbf9aa026 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:55:59.234122 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:55:59.239199 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6a488ffe-aa4e-4ad0-93c7-c98bbf9aa026 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:59.244829 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6a488ffe-aa4e-4ad0-93c7-c98bbf9aa026 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:59.244829 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6a488ffe-aa4e-4ad0-93c7-c98bbf9aa026 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:59.244829 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6a488ffe-aa4e-4ad0-93c7-c98bbf9aa026 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:55:59.244829 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6a488ffe-aa4e-4ad0-93c7-c98bbf9aa026 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:55:59.245432 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6a488ffe-aa4e-4ad0-93c7-c98bbf9aa026 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:55:59.414549 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6a488ffe-aa4e-4ad0-93c7-c98bbf9aa026 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:55:59.423224 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6a488ffe-aa4e-4ad0-93c7-c98bbf9aa026 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.196370 Aug 08 16:55:59.423818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 270/519] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:55:59 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:00.456015 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7b363e2c-f7b3-4550-8278-c4af7a5aab53 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:00.458349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7b363e2c-f7b3-4550-8278-c4af7a5aab53 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:00.471283 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b363e2c-f7b3-4550-8278-c4af7a5aab53 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:00.472198 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b363e2c-f7b3-4550-8278-c4af7a5aab53 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:00.473141 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b363e2c-f7b3-4550-8278-c4af7a5aab53 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:00.474391 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b363e2c-f7b3-4550-8278-c4af7a5aab53 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:00.475259 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b363e2c-f7b3-4550-8278-c4af7a5aab53 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:00.476034 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b363e2c-f7b3-4550-8278-c4af7a5aab53 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:00.655982 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7b363e2c-f7b3-4550-8278-c4af7a5aab53 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:00.665801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7b363e2c-f7b3-4550-8278-c4af7a5aab53 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.218305 Aug 08 16:56:00.666824 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 250/520] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:00 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:01.697607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a28394d9-e79c-45ea-8b01-c68a39459037 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:01.698511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a28394d9-e79c-45ea-8b01-c68a39459037 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:01.707698 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a28394d9-e79c-45ea-8b01-c68a39459037 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:01.708246 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a28394d9-e79c-45ea-8b01-c68a39459037 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:01.708899 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a28394d9-e79c-45ea-8b01-c68a39459037 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:01.709994 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a28394d9-e79c-45ea-8b01-c68a39459037 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:01.710505 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a28394d9-e79c-45ea-8b01-c68a39459037 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:01.711015 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a28394d9-e79c-45ea-8b01-c68a39459037 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:01.902511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a28394d9-e79c-45ea-8b01-c68a39459037 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:01.913226 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a28394d9-e79c-45ea-8b01-c68a39459037 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.220793 Aug 08 16:56:01.914048 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 271/521] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:01 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:02.939491 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2e0377cc-25eb-4e5d-a189-efeabe7b1d98 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:02.940189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2e0377cc-25eb-4e5d-a189-efeabe7b1d98 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:02.946942 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2e0377cc-25eb-4e5d-a189-efeabe7b1d98 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:02.947445 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2e0377cc-25eb-4e5d-a189-efeabe7b1d98 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:02.947882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2e0377cc-25eb-4e5d-a189-efeabe7b1d98 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:02.948898 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2e0377cc-25eb-4e5d-a189-efeabe7b1d98 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:02.949617 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2e0377cc-25eb-4e5d-a189-efeabe7b1d98 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:02.951315 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2e0377cc-25eb-4e5d-a189-efeabe7b1d98 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:03.136201 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2e0377cc-25eb-4e5d-a189-efeabe7b1d98 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:03.145678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2e0377cc-25eb-4e5d-a189-efeabe7b1d98 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.212404 Aug 08 16:56:03.146286 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 251/522] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:02 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:03.231834 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-891b9a52-60d3-4ecd-86ed-da281c256ee4 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:03.232887 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-891b9a52-60d3-4ecd-86ed-da281c256ee4 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:03.243058 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-891b9a52-60d3-4ecd-86ed-da281c256ee4 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:03.244133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-891b9a52-60d3-4ecd-86ed-da281c256ee4 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:03.244892 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-891b9a52-60d3-4ecd-86ed-da281c256ee4 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:03.246182 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-891b9a52-60d3-4ecd-86ed-da281c256ee4 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:03.247548 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-891b9a52-60d3-4ecd-86ed-da281c256ee4 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:03.248396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-891b9a52-60d3-4ecd-86ed-da281c256ee4 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:03.453099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-891b9a52-60d3-4ecd-86ed-da281c256ee4 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lazy-loading 'services' on Instance uuid c162d1e6-28a1-4af7-a11f-8ac7b6912a35 {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:56:03.755963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-891b9a52-60d3-4ecd-86ed-da281c256ee4 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35/os-volume_attachments/dc08de0d-33df-4fe8-bf1b-45a02db2c8f0" status: 202 len: 0 microversion: 2.1 time: 0.532358 Aug 08 16:56:03.756761 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 272/523] 10.222.0.13 () {58 vars in 1416 bytes} [Mon Aug 8 16:56:03 2022] DELETE /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35/os-volume_attachments/dc08de0d-33df-4fe8-bf1b-45a02db2c8f0 => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:56:04.185326 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a511cd5a-c4d7-4172-8b2c-cf2c59805fb8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:04.186176 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a511cd5a-c4d7-4172-8b2c-cf2c59805fb8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:04.195709 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a511cd5a-c4d7-4172-8b2c-cf2c59805fb8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:04.196563 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a511cd5a-c4d7-4172-8b2c-cf2c59805fb8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:04.197355 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a511cd5a-c4d7-4172-8b2c-cf2c59805fb8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:04.198688 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a511cd5a-c4d7-4172-8b2c-cf2c59805fb8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:04.199638 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a511cd5a-c4d7-4172-8b2c-cf2c59805fb8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:04.200384 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a511cd5a-c4d7-4172-8b2c-cf2c59805fb8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:04.405436 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a511cd5a-c4d7-4172-8b2c-cf2c59805fb8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:04.414491 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a511cd5a-c4d7-4172-8b2c-cf2c59805fb8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.238490 Aug 08 16:56:04.415315 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 252/524] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:04 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:05.450491 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-48de75a6-de9b-4126-bb75-401ae60fb418 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:05.451430 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-48de75a6-de9b-4126-bb75-401ae60fb418 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:05.458277 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-48de75a6-de9b-4126-bb75-401ae60fb418 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:05.459005 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-48de75a6-de9b-4126-bb75-401ae60fb418 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:05.459581 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-48de75a6-de9b-4126-bb75-401ae60fb418 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:05.460579 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-48de75a6-de9b-4126-bb75-401ae60fb418 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:05.461147 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-48de75a6-de9b-4126-bb75-401ae60fb418 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:05.461607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-48de75a6-de9b-4126-bb75-401ae60fb418 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:05.623858 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-48de75a6-de9b-4126-bb75-401ae60fb418 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:05.632477 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-48de75a6-de9b-4126-bb75-401ae60fb418 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.188809 Aug 08 16:56:05.633086 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 273/525] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:05 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:06.654545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ecea9834-628a-44d2-9d06-6c46d0025c07 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:06.655251 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ecea9834-628a-44d2-9d06-6c46d0025c07 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:06.657656 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:56:06.662893 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ecea9834-628a-44d2-9d06-6c46d0025c07 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:06.663515 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ecea9834-628a-44d2-9d06-6c46d0025c07 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:06.670340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ecea9834-628a-44d2-9d06-6c46d0025c07 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:06.670340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ecea9834-628a-44d2-9d06-6c46d0025c07 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:06.670340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ecea9834-628a-44d2-9d06-6c46d0025c07 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:06.670340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ecea9834-628a-44d2-9d06-6c46d0025c07 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:06.843546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ecea9834-628a-44d2-9d06-6c46d0025c07 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:06.859647 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ecea9834-628a-44d2-9d06-6c46d0025c07 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.209290 Aug 08 16:56:06.862693 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 253/526] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:06 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:07.886531 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2311cd0e-cace-441f-b968-68f3753ecc90 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:07.888894 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2311cd0e-cace-441f-b968-68f3753ecc90 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:07.894980 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2311cd0e-cace-441f-b968-68f3753ecc90 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:07.895478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2311cd0e-cace-441f-b968-68f3753ecc90 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:07.895922 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2311cd0e-cace-441f-b968-68f3753ecc90 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:07.896658 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2311cd0e-cace-441f-b968-68f3753ecc90 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:07.897120 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2311cd0e-cace-441f-b968-68f3753ecc90 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:07.897549 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2311cd0e-cace-441f-b968-68f3753ecc90 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:08.062330 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2311cd0e-cace-441f-b968-68f3753ecc90 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:08.070886 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2311cd0e-cace-441f-b968-68f3753ecc90 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.188227 Aug 08 16:56:08.071480 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 274/527] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:07 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:09.107234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-28b477be-4043-4c6d-a504-4c0109e0ffba tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:09.107863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-28b477be-4043-4c6d-a504-4c0109e0ffba tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:09.114887 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-28b477be-4043-4c6d-a504-4c0109e0ffba tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:09.115392 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-28b477be-4043-4c6d-a504-4c0109e0ffba tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:09.115832 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-28b477be-4043-4c6d-a504-4c0109e0ffba tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:09.116566 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-28b477be-4043-4c6d-a504-4c0109e0ffba tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:09.117025 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-28b477be-4043-4c6d-a504-4c0109e0ffba tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:09.117542 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-28b477be-4043-4c6d-a504-4c0109e0ffba tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:09.278448 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-28b477be-4043-4c6d-a504-4c0109e0ffba tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:09.286501 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-28b477be-4043-4c6d-a504-4c0109e0ffba tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.184027 Aug 08 16:56:09.287137 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 254/528] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:09 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:10.309080 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-835693b5-abda-4cfb-a631-59733f5a0b17 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:10.310999 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-835693b5-abda-4cfb-a631-59733f5a0b17 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:10.326863 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-835693b5-abda-4cfb-a631-59733f5a0b17 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:10.327368 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-835693b5-abda-4cfb-a631-59733f5a0b17 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:10.327811 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-835693b5-abda-4cfb-a631-59733f5a0b17 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:10.328542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-835693b5-abda-4cfb-a631-59733f5a0b17 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:10.329123 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-835693b5-abda-4cfb-a631-59733f5a0b17 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:10.329493 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-835693b5-abda-4cfb-a631-59733f5a0b17 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:10.495323 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-f72b1aed-2845-400f-af67-50d2e647777f req-4fbb86c5-d20f-47fe-bcce-7973f1e1951c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "173f1a4f-1673-4644-8730-67eaf9df2b61", "tag": "e664734d-6d99-473f-9417-434a305e356c"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:56:10.523414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-f72b1aed-2845-400f-af67-50d2e647777f req-4fbb86c5-d20f-47fe-bcce-7973f1e1951c service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:10.524278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-f72b1aed-2845-400f-af67-50d2e647777f req-4fbb86c5-d20f-47fe-bcce-7973f1e1951c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:10.525045 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-f72b1aed-2845-400f-af67-50d2e647777f req-4fbb86c5-d20f-47fe-bcce-7973f1e1951c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:10.548597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-f72b1aed-2845-400f-af67-50d2e647777f req-4fbb86c5-d20f-47fe-bcce-7973f1e1951c service nova] Creating event network-changed:e664734d-6d99-473f-9417-434a305e356c for instance 173f1a4f-1673-4644-8730-67eaf9df2b61 on hv-cinder-85220 Aug 08 16:56:10.558351 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-f72b1aed-2845-400f-af67-50d2e647777f req-4fbb86c5-d20f-47fe-bcce-7973f1e1951c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069942 Aug 08 16:56:10.560795 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 255/529] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:56:10.581631 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-835693b5-abda-4cfb-a631-59733f5a0b17 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:10.591782 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-835693b5-abda-4cfb-a631-59733f5a0b17 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.286515 Aug 08 16:56:10.592391 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 275/530] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:10 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:11.614068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a1102c4c-495b-4f2e-b316-e8d0e4074301 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:11.614935 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a1102c4c-495b-4f2e-b316-e8d0e4074301 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:11.625347 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a1102c4c-495b-4f2e-b316-e8d0e4074301 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:11.626194 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a1102c4c-495b-4f2e-b316-e8d0e4074301 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:11.626888 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a1102c4c-495b-4f2e-b316-e8d0e4074301 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:11.627966 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a1102c4c-495b-4f2e-b316-e8d0e4074301 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:11.628475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a1102c4c-495b-4f2e-b316-e8d0e4074301 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:11.628939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a1102c4c-495b-4f2e-b316-e8d0e4074301 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:11.787120 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a1102c4c-495b-4f2e-b316-e8d0e4074301 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:11.797708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a1102c4c-495b-4f2e-b316-e8d0e4074301 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.188286 Aug 08 16:56:11.798633 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 256/531] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:11 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:12.832030 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-63d11788-0d2d-4be9-9d80-4e5f0be6ae04 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:12.832659 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-63d11788-0d2d-4be9-9d80-4e5f0be6ae04 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:12.839894 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63d11788-0d2d-4be9-9d80-4e5f0be6ae04 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:12.840400 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63d11788-0d2d-4be9-9d80-4e5f0be6ae04 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:12.840970 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63d11788-0d2d-4be9-9d80-4e5f0be6ae04 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:12.841705 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63d11788-0d2d-4be9-9d80-4e5f0be6ae04 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:12.842169 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63d11788-0d2d-4be9-9d80-4e5f0be6ae04 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:12.842621 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63d11788-0d2d-4be9-9d80-4e5f0be6ae04 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:12.999472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-63d11788-0d2d-4be9-9d80-4e5f0be6ae04 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:13.007757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-63d11788-0d2d-4be9-9d80-4e5f0be6ae04 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.179790 Aug 08 16:56:13.008354 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 276/532] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:12 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:14.031957 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2c213d42-7582-48a9-a69f-8fdfb1bbfa4f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:14.032702 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2c213d42-7582-48a9-a69f-8fdfb1bbfa4f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:14.040229 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c213d42-7582-48a9-a69f-8fdfb1bbfa4f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:14.040727 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c213d42-7582-48a9-a69f-8fdfb1bbfa4f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:14.041163 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c213d42-7582-48a9-a69f-8fdfb1bbfa4f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:14.041894 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c213d42-7582-48a9-a69f-8fdfb1bbfa4f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:14.042329 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c213d42-7582-48a9-a69f-8fdfb1bbfa4f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:14.043553 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c213d42-7582-48a9-a69f-8fdfb1bbfa4f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:14.197171 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2c213d42-7582-48a9-a69f-8fdfb1bbfa4f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:14.212592 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2c213d42-7582-48a9-a69f-8fdfb1bbfa4f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.186331 Aug 08 16:56:14.213560 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 257/533] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:14 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:15.235545 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-76bf436d-db93-4e38-a846-464142758138 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:15.236447 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-76bf436d-db93-4e38-a846-464142758138 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:15.243951 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76bf436d-db93-4e38-a846-464142758138 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:15.244447 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76bf436d-db93-4e38-a846-464142758138 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:15.244882 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76bf436d-db93-4e38-a846-464142758138 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:15.245607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76bf436d-db93-4e38-a846-464142758138 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:15.246617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76bf436d-db93-4e38-a846-464142758138 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:15.247051 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76bf436d-db93-4e38-a846-464142758138 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:15.400864 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-76bf436d-db93-4e38-a846-464142758138 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:15.409294 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-76bf436d-db93-4e38-a846-464142758138 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.177953 Aug 08 16:56:15.409975 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 277/534] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:15 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:16.436562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-851fcfe4-ecd8-4201-8149-043ff6c0da9e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:16.437831 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-851fcfe4-ecd8-4201-8149-043ff6c0da9e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:16.450001 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-851fcfe4-ecd8-4201-8149-043ff6c0da9e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:16.450951 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-851fcfe4-ecd8-4201-8149-043ff6c0da9e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:16.451731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-851fcfe4-ecd8-4201-8149-043ff6c0da9e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:16.453046 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-851fcfe4-ecd8-4201-8149-043ff6c0da9e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:16.453946 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-851fcfe4-ecd8-4201-8149-043ff6c0da9e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:16.454772 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-851fcfe4-ecd8-4201-8149-043ff6c0da9e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:16.641290 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-851fcfe4-ecd8-4201-8149-043ff6c0da9e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:16.656528 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-851fcfe4-ecd8-4201-8149-043ff6c0da9e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.226957 Aug 08 16:56:16.657568 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 258/535] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:16 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:17.689473 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6ce5bb81-464b-4a70-a800-4cfb71bec154 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:17.691850 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6ce5bb81-464b-4a70-a800-4cfb71bec154 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:17.697308 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6ce5bb81-464b-4a70-a800-4cfb71bec154 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:17.697798 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6ce5bb81-464b-4a70-a800-4cfb71bec154 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:17.698238 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6ce5bb81-464b-4a70-a800-4cfb71bec154 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:17.699494 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6ce5bb81-464b-4a70-a800-4cfb71bec154 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:17.699955 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6ce5bb81-464b-4a70-a800-4cfb71bec154 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:17.700383 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6ce5bb81-464b-4a70-a800-4cfb71bec154 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:17.875558 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6ce5bb81-464b-4a70-a800-4cfb71bec154 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:17.884010 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6ce5bb81-464b-4a70-a800-4cfb71bec154 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.198465 Aug 08 16:56:17.884680 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 278/536] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:17 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:18.912603 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e2a8c114-91f3-4ce2-a2de-aa50b32399f8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:18.913349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e2a8c114-91f3-4ce2-a2de-aa50b32399f8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:18.925922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e2a8c114-91f3-4ce2-a2de-aa50b32399f8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:18.926824 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e2a8c114-91f3-4ce2-a2de-aa50b32399f8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:18.927588 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e2a8c114-91f3-4ce2-a2de-aa50b32399f8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:18.928466 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e2a8c114-91f3-4ce2-a2de-aa50b32399f8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:18.928999 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e2a8c114-91f3-4ce2-a2de-aa50b32399f8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:18.929488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e2a8c114-91f3-4ce2-a2de-aa50b32399f8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:19.124070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e2a8c114-91f3-4ce2-a2de-aa50b32399f8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:19.130828 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e2a8c114-91f3-4ce2-a2de-aa50b32399f8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.227056 Aug 08 16:56:19.131421 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 259/537] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:18 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:20.153269 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-dd644852-5be3-4b49-8d64-3e83b7aba174 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:20.154051 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-dd644852-5be3-4b49-8d64-3e83b7aba174 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:20.161347 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dd644852-5be3-4b49-8d64-3e83b7aba174 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:20.161961 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dd644852-5be3-4b49-8d64-3e83b7aba174 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:20.162421 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dd644852-5be3-4b49-8d64-3e83b7aba174 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:20.163251 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dd644852-5be3-4b49-8d64-3e83b7aba174 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:20.163924 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dd644852-5be3-4b49-8d64-3e83b7aba174 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:20.164347 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dd644852-5be3-4b49-8d64-3e83b7aba174 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:20.321453 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-dd644852-5be3-4b49-8d64-3e83b7aba174 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:20.332142 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-dd644852-5be3-4b49-8d64-3e83b7aba174 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.182810 Aug 08 16:56:20.332793 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 279/538] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:20 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:21.359885 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b305c37e-bd4c-4aa8-84ce-aadd263a6b5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:21.361288 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b305c37e-bd4c-4aa8-84ce-aadd263a6b5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:21.378738 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b305c37e-bd4c-4aa8-84ce-aadd263a6b5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:21.378738 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b305c37e-bd4c-4aa8-84ce-aadd263a6b5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:21.378738 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b305c37e-bd4c-4aa8-84ce-aadd263a6b5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:21.378738 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b305c37e-bd4c-4aa8-84ce-aadd263a6b5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:21.379481 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b305c37e-bd4c-4aa8-84ce-aadd263a6b5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:21.379481 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b305c37e-bd4c-4aa8-84ce-aadd263a6b5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:21.557716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b305c37e-bd4c-4aa8-84ce-aadd263a6b5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:21.566799 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b305c37e-bd4c-4aa8-84ce-aadd263a6b5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.215924 Aug 08 16:56:21.567440 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 260/539] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:21 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:22.161584 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1971fd7b-49c8-407b-9b2d-5c62b1f4e3f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:22.162232 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1971fd7b-49c8-407b-9b2d-5c62b1f4e3f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:22.170835 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1971fd7b-49c8-407b-9b2d-5c62b1f4e3f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:22.171463 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1971fd7b-49c8-407b-9b2d-5c62b1f4e3f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:22.172078 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1971fd7b-49c8-407b-9b2d-5c62b1f4e3f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:22.172973 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1971fd7b-49c8-407b-9b2d-5c62b1f4e3f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:22.173555 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1971fd7b-49c8-407b-9b2d-5c62b1f4e3f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:22.174069 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1971fd7b-49c8-407b-9b2d-5c62b1f4e3f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:22.207192 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1971fd7b-49c8-407b-9b2d-5c62b1f4e3f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:56:22.578059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1971fd7b-49c8-407b-9b2d-5c62b1f4e3f1 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 204 len: 0 microversion: 2.1 time: 0.420307 Aug 08 16:56:22.578712 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 280/540] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:56:22 2022] DELETE /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 16:56:22.590943 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e082b4b7-6343-4ec8-9f8b-90007a7bcb38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:22.591735 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e082b4b7-6343-4ec8-9f8b-90007a7bcb38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:22.592415 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-86f2f0be-9d99-48a1-953f-598833efd330 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:22.593528 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-86f2f0be-9d99-48a1-953f-598833efd330 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:22.598290 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e082b4b7-6343-4ec8-9f8b-90007a7bcb38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:22.598824 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e082b4b7-6343-4ec8-9f8b-90007a7bcb38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:22.599251 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e082b4b7-6343-4ec8-9f8b-90007a7bcb38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:22.599964 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e082b4b7-6343-4ec8-9f8b-90007a7bcb38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:22.600406 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e082b4b7-6343-4ec8-9f8b-90007a7bcb38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:22.600824 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e082b4b7-6343-4ec8-9f8b-90007a7bcb38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:22.604778 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-86f2f0be-9d99-48a1-953f-598833efd330 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:22.605656 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-86f2f0be-9d99-48a1-953f-598833efd330 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:22.606440 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-86f2f0be-9d99-48a1-953f-598833efd330 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:22.607687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-86f2f0be-9d99-48a1-953f-598833efd330 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:22.608435 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-86f2f0be-9d99-48a1-953f-598833efd330 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:22.609146 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-86f2f0be-9d99-48a1-953f-598833efd330 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:22.769709 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e082b4b7-6343-4ec8-9f8b-90007a7bcb38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:22.783715 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e082b4b7-6343-4ec8-9f8b-90007a7bcb38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.198220 Aug 08 16:56:22.784761 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 281/541] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:22 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:22.801977 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-86f2f0be-9d99-48a1-953f-598833efd330 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:22.812418 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-86f2f0be-9d99-48a1-953f-598833efd330 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1515 microversion: 2.1 time: 0.228574 Aug 08 16:56:22.813057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 261/542] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:22 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:23.805315 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c74a9962-87f7-460e-b115-a581990edcf2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:23.805965 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c74a9962-87f7-460e-b115-a581990edcf2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:23.814149 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c74a9962-87f7-460e-b115-a581990edcf2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:23.814914 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c74a9962-87f7-460e-b115-a581990edcf2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:23.815558 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c74a9962-87f7-460e-b115-a581990edcf2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:23.816598 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c74a9962-87f7-460e-b115-a581990edcf2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:23.817255 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c74a9962-87f7-460e-b115-a581990edcf2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:23.817888 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c74a9962-87f7-460e-b115-a581990edcf2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:23.848792 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8f4acc96-c511-47e2-90c4-87e97391da68 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:23.849800 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8f4acc96-c511-47e2-90c4-87e97391da68 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:23.859619 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8f4acc96-c511-47e2-90c4-87e97391da68 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:23.860577 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8f4acc96-c511-47e2-90c4-87e97391da68 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:23.861555 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8f4acc96-c511-47e2-90c4-87e97391da68 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:23.862868 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8f4acc96-c511-47e2-90c4-87e97391da68 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:23.863863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8f4acc96-c511-47e2-90c4-87e97391da68 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:23.864637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8f4acc96-c511-47e2-90c4-87e97391da68 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:24.055242 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c74a9962-87f7-460e-b115-a581990edcf2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:24.074106 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c74a9962-87f7-460e-b115-a581990edcf2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.269145 Aug 08 16:56:24.074106 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 282/543] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:23 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:24.085576 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8f4acc96-c511-47e2-90c4-87e97391da68 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:24.094964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8f4acc96-c511-47e2-90c4-87e97391da68 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1515 microversion: 2.1 time: 0.253312 Aug 08 16:56:24.095589 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 262/544] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:23 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:25.106953 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-49bde6a8-5049-4f77-8fc0-24f62e0ff1b5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:25.107531 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-49bde6a8-5049-4f77-8fc0-24f62e0ff1b5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:25.117139 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49bde6a8-5049-4f77-8fc0-24f62e0ff1b5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:25.117921 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49bde6a8-5049-4f77-8fc0-24f62e0ff1b5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:25.118678 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49bde6a8-5049-4f77-8fc0-24f62e0ff1b5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:25.119779 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49bde6a8-5049-4f77-8fc0-24f62e0ff1b5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:25.121139 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49bde6a8-5049-4f77-8fc0-24f62e0ff1b5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:25.121888 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49bde6a8-5049-4f77-8fc0-24f62e0ff1b5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:25.123781 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-62c869da-4fa1-44d6-af55-c5c19c78350c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:25.124930 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-62c869da-4fa1-44d6-af55-c5c19c78350c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:25.134013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-62c869da-4fa1-44d6-af55-c5c19c78350c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:25.134507 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-62c869da-4fa1-44d6-af55-c5c19c78350c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:25.134997 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-62c869da-4fa1-44d6-af55-c5c19c78350c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:25.135821 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-62c869da-4fa1-44d6-af55-c5c19c78350c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:25.136297 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-62c869da-4fa1-44d6-af55-c5c19c78350c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:25.136722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-62c869da-4fa1-44d6-af55-c5c19c78350c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:25.141178 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:56:25.291894 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-49bde6a8-5049-4f77-8fc0-24f62e0ff1b5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:25.301097 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-49bde6a8-5049-4f77-8fc0-24f62e0ff1b5 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.198653 Aug 08 16:56:25.301749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 283/545] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:25 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:25.315921 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-62c869da-4fa1-44d6-af55-c5c19c78350c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:25.324413 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-62c869da-4fa1-44d6-af55-c5c19c78350c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1515 microversion: 2.1 time: 0.209002 Aug 08 16:56:25.325014 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 263/546] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:25 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:26.326001 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b4e0e735-c287-4388-959d-60fd217070d2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:26.326689 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b4e0e735-c287-4388-959d-60fd217070d2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:26.334221 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b4e0e735-c287-4388-959d-60fd217070d2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:26.334784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b4e0e735-c287-4388-959d-60fd217070d2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:26.335232 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b4e0e735-c287-4388-959d-60fd217070d2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:26.335960 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b4e0e735-c287-4388-959d-60fd217070d2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:26.336419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b4e0e735-c287-4388-959d-60fd217070d2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:26.336848 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b4e0e735-c287-4388-959d-60fd217070d2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:26.346669 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-659e1e92-f3fb-4c3c-8f76-051aa6b9f394 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:26.347498 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-659e1e92-f3fb-4c3c-8f76-051aa6b9f394 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:26.354144 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-659e1e92-f3fb-4c3c-8f76-051aa6b9f394 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:26.355321 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-659e1e92-f3fb-4c3c-8f76-051aa6b9f394 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:26.356573 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-659e1e92-f3fb-4c3c-8f76-051aa6b9f394 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:26.357318 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-659e1e92-f3fb-4c3c-8f76-051aa6b9f394 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:26.357786 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-659e1e92-f3fb-4c3c-8f76-051aa6b9f394 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:26.358213 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-659e1e92-f3fb-4c3c-8f76-051aa6b9f394 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:26.520816 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b4e0e735-c287-4388-959d-60fd217070d2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:26.536931 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b4e0e735-c287-4388-959d-60fd217070d2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.215364 Aug 08 16:56:26.538459 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 284/547] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:26 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:26.565218 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-659e1e92-f3fb-4c3c-8f76-051aa6b9f394 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:26.580729 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-659e1e92-f3fb-4c3c-8f76-051aa6b9f394 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1515 microversion: 2.1 time: 0.237361 Aug 08 16:56:26.581686 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 264/548] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:26 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:27.560752 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fd5fafab-bdf7-4ee9-a533-8664caf722c6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:27.561344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fd5fafab-bdf7-4ee9-a533-8664caf722c6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:27.568325 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd5fafab-bdf7-4ee9-a533-8664caf722c6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:27.568812 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd5fafab-bdf7-4ee9-a533-8664caf722c6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:27.569501 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd5fafab-bdf7-4ee9-a533-8664caf722c6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:27.570211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd5fafab-bdf7-4ee9-a533-8664caf722c6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:27.570694 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd5fafab-bdf7-4ee9-a533-8664caf722c6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:27.571121 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd5fafab-bdf7-4ee9-a533-8664caf722c6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:27.614060 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2a5938bb-9390-4164-beb2-48a14e743ad2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:27.614930 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2a5938bb-9390-4164-beb2-48a14e743ad2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:27.623236 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a5938bb-9390-4164-beb2-48a14e743ad2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:27.623936 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a5938bb-9390-4164-beb2-48a14e743ad2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:27.624502 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a5938bb-9390-4164-beb2-48a14e743ad2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:27.625417 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a5938bb-9390-4164-beb2-48a14e743ad2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:27.626293 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a5938bb-9390-4164-beb2-48a14e743ad2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:27.627161 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a5938bb-9390-4164-beb2-48a14e743ad2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:27.787574 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2a5938bb-9390-4164-beb2-48a14e743ad2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:27.798345 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2a5938bb-9390-4164-beb2-48a14e743ad2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1515 microversion: 2.1 time: 0.188382 Aug 08 16:56:27.799242 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 265/549] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:27 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:27.871167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fd5fafab-bdf7-4ee9-a533-8664caf722c6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:27.883738 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fd5fafab-bdf7-4ee9-a533-8664caf722c6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.327580 Aug 08 16:56:27.884802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 285/550] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:27 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:28.821422 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-94737b40-9cf2-45c6-b69f-e6923818d952 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:28.821422 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-94737b40-9cf2-45c6-b69f-e6923818d952 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:28.827262 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-94737b40-9cf2-45c6-b69f-e6923818d952 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:28.827755 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-94737b40-9cf2-45c6-b69f-e6923818d952 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:28.828193 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-94737b40-9cf2-45c6-b69f-e6923818d952 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:28.829018 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-94737b40-9cf2-45c6-b69f-e6923818d952 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:28.829471 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-94737b40-9cf2-45c6-b69f-e6923818d952 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:28.829899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-94737b40-9cf2-45c6-b69f-e6923818d952 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:28.832749 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=98 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:56:28.923760 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e3fa259d-314d-4219-8208-30756f888273 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:28.927684 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e3fa259d-314d-4219-8208-30756f888273 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:28.943081 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3fa259d-314d-4219-8208-30756f888273 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:28.944283 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3fa259d-314d-4219-8208-30756f888273 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:28.945065 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3fa259d-314d-4219-8208-30756f888273 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:28.946397 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3fa259d-314d-4219-8208-30756f888273 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:28.947502 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3fa259d-314d-4219-8208-30756f888273 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:28.948872 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e3fa259d-314d-4219-8208-30756f888273 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:29.043911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-94737b40-9cf2-45c6-b69f-e6923818d952 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:29.058741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-94737b40-9cf2-45c6-b69f-e6923818d952 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1515 microversion: 2.1 time: 0.242275 Aug 08 16:56:29.060878 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 266/551] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:28 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:29.141760 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-219a7e0a-4029-4b33-a695-7e0cdbc57594 req-1884bb1a-f4af-4382-a97e-5a1f212aa7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c162d1e6-28a1-4af7-a11f-8ac7b6912a35", "name": "network-vif-deleted", "tag": "bfa4314e-54cb-4bcf-ad62-d4a047f3db20"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:56:29.158805 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-219a7e0a-4029-4b33-a695-7e0cdbc57594 req-1884bb1a-f4af-4382-a97e-5a1f212aa7aa service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:29.159641 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-219a7e0a-4029-4b33-a695-7e0cdbc57594 req-1884bb1a-f4af-4382-a97e-5a1f212aa7aa service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:29.160403 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-219a7e0a-4029-4b33-a695-7e0cdbc57594 req-1884bb1a-f4af-4382-a97e-5a1f212aa7aa service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:29.180477 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-219a7e0a-4029-4b33-a695-7e0cdbc57594 req-1884bb1a-f4af-4382-a97e-5a1f212aa7aa service nova] Creating event network-vif-deleted:bfa4314e-54cb-4bcf-ad62-d4a047f3db20 for instance c162d1e6-28a1-4af7-a11f-8ac7b6912a35 on hv-cinder-85220 Aug 08 16:56:29.187263 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-219a7e0a-4029-4b33-a695-7e0cdbc57594 req-1884bb1a-f4af-4382-a97e-5a1f212aa7aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062755 Aug 08 16:56:29.188058 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 267/552] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:56:29.229390 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e3fa259d-314d-4219-8208-30756f888273 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:29.232061 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-efe6b0de-163a-4423-806a-b49cd3d0bce5 req-73930c34-0d0f-4760-ba32-4d8489c3a219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "173f1a4f-1673-4644-8730-67eaf9df2b61", "name": "network-vif-plugged", "status": "completed", "tag": "e664734d-6d99-473f-9417-434a305e356c"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:56:29.241001 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e3fa259d-314d-4219-8208-30756f888273 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.326391 Aug 08 16:56:29.241683 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 286/553] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:28 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:29.250123 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-efe6b0de-163a-4423-806a-b49cd3d0bce5 req-73930c34-0d0f-4760-ba32-4d8489c3a219 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:29.250710 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-efe6b0de-163a-4423-806a-b49cd3d0bce5 req-73930c34-0d0f-4760-ba32-4d8489c3a219 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:29.251398 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-efe6b0de-163a-4423-806a-b49cd3d0bce5 req-73930c34-0d0f-4760-ba32-4d8489c3a219 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:29.269231 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-efe6b0de-163a-4423-806a-b49cd3d0bce5 req-73930c34-0d0f-4760-ba32-4d8489c3a219 service nova] Creating event network-vif-plugged:e664734d-6d99-473f-9417-434a305e356c for instance 173f1a4f-1673-4644-8730-67eaf9df2b61 on hv-cinder-85220 Aug 08 16:56:29.278539 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-efe6b0de-163a-4423-806a-b49cd3d0bce5 req-73930c34-0d0f-4760-ba32-4d8489c3a219 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055314 Aug 08 16:56:29.280430 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 268/554] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:56:29.287197 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e7aa3306-ad71-4249-83f4-6b8590ef9bc2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:29.287706 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e7aa3306-ad71-4249-83f4-6b8590ef9bc2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:29.298233 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e7aa3306-ad71-4249-83f4-6b8590ef9bc2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:29.299150 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e7aa3306-ad71-4249-83f4-6b8590ef9bc2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:29.300773 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e7aa3306-ad71-4249-83f4-6b8590ef9bc2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:29.302248 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e7aa3306-ad71-4249-83f4-6b8590ef9bc2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:29.303127 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e7aa3306-ad71-4249-83f4-6b8590ef9bc2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:29.303902 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e7aa3306-ad71-4249-83f4-6b8590ef9bc2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:29.335165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e7aa3306-ad71-4249-83f4-6b8590ef9bc2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/ips" status: 200 len: 151 microversion: 2.20 time: 0.053844 Aug 08 16:56:29.335652 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 287/555] 10.222.0.13 () {60 vars in 1289 bytes} [Mon Aug 8 16:56:29 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/ips => generated 151 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:56:30.082884 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:30.084877 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:30.092292 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:30.093172 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:30.093707 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:30.094696 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:30.095388 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:30.095820 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:30.148040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:30.148532 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:30.149026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:30.149634 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lazy-loading 'fault' on Instance uuid c162d1e6-28a1-4af7-a11f-8ac7b6912a35 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:56:30.226711 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:30.238313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-75578bab-32d1-47f9-8c96-645fb686b66f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 200 len: 1309 microversion: 2.1 time: 0.159350 Aug 08 16:56:30.239067 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 269/556] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:30 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:30.272054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-93cd841b-75ed-4a51-bbe7-d600389ec861 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:30.277514 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-93cd841b-75ed-4a51-bbe7-d600389ec861 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:30.277514 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:56:30.281780 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-93cd841b-75ed-4a51-bbe7-d600389ec861 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:30.282395 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-93cd841b-75ed-4a51-bbe7-d600389ec861 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:30.283047 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-93cd841b-75ed-4a51-bbe7-d600389ec861 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:30.284051 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-93cd841b-75ed-4a51-bbe7-d600389ec861 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:30.284659 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-93cd841b-75ed-4a51-bbe7-d600389ec861 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:30.285179 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-93cd841b-75ed-4a51-bbe7-d600389ec861 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:30.488572 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-93cd841b-75ed-4a51-bbe7-d600389ec861 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:30.497396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-93cd841b-75ed-4a51-bbe7-d600389ec861 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.230324 Aug 08 16:56:30.498002 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 288/557] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:30 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:31.261957 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0f07ca96-78ce-4222-b3dd-8684765109b2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:31.262732 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0f07ca96-78ce-4222-b3dd-8684765109b2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: c162d1e6-28a1-4af7-a11f-8ac7b6912a35] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:31.268915 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f07ca96-78ce-4222-b3dd-8684765109b2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:31.269399 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f07ca96-78ce-4222-b3dd-8684765109b2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:31.269828 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f07ca96-78ce-4222-b3dd-8684765109b2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:31.270592 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f07ca96-78ce-4222-b3dd-8684765109b2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:31.271059 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f07ca96-78ce-4222-b3dd-8684765109b2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:31.271490 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f07ca96-78ce-4222-b3dd-8684765109b2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:31.292600 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-0f07ca96-78ce-4222-b3dd-8684765109b2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] HTTP exception thrown: Instance c162d1e6-28a1-4af7-a11f-8ac7b6912a35 could not be found. Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0f07ca96-78ce-4222-b3dd-8684765109b2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Request method failure captured: Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 HTTP/1.1 Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T-y5nCNglxGdjnXaEGyBdv83qy5WhinjwEclBO4xA222LUyt7kxLHSjHikgR56mtK739bMALoK_6Z4wIVogaWN0enLuCNCOzrjptXCWxC-0L3_hcSGoaeYpqWaMekvFamKrq7MIbSKXmvMwmCBfUFk0RrTIRWaFj2uDDVoIe0hxTT4 Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 49844b73a63b4c338fc5109f70ba774e Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-VolumesSnapshotTestJSON-174063897 Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:56:31.294637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:56:31.296212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49844b73a63b4c338fc5109f70ba774e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49844b73a63b4c338fc5109f70ba774e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49844b73a63b4c338fc5109f70ba774e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49844b73a63b4c338fc5109f70ba774e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:56:31.296212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-VolumesSnapshotTestJSON-174063897 Aug 08 16:56:31.296212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 49844b73a63b4c338fc5109f70ba774e Aug 08 16:56:31.296212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-174063897 Aug 08 16:56:31.296212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-VolumesSnapshotTestJSON-174063897-project Aug 08 16:56:31.296212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:56:31.296212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:56:31.296212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: 683bed0160e54791a8e638523ac7e460 Aug 08 16:56:31.296212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-VolumesSnapshotTestJSON-174063897-project Aug 08 16:56:31.296212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:56:31.296212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance c162d1e6-28a1-4af7-a11f-8ac7b6912a35 could not be found. Aug 08 16:56:31.296212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'c162d1e6-28a1-4af7-a11f-8ac7b6912a35'} Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c162d1e6-28a1-4af7-a11f-8ac7b6912a35 could not be found. Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:56:31.297040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c162d1e6-28a1-4af7-a11f-8ac7b6912a35 could not be found. Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c162d1e6-28a1-4af7-a11f-8ac7b6912a35 could not be found. Aug 08 16:56:31.303533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:56:31.304978 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0f07ca96-78ce-4222-b3dd-8684765109b2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Returning 404 to user: Instance c162d1e6-28a1-4af7-a11f-8ac7b6912a35 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:56:31.304978 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0f07ca96-78ce-4222-b3dd-8684765109b2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35" status: 404 len: 111 microversion: 2.1 time: 0.039124 Aug 08 16:56:31.304978 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 270/558] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:31 2022] GET /compute/v2.1/servers/c162d1e6-28a1-4af7-a11f-8ac7b6912a35 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:56:31.519403 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-88e7ffb8-0963-4a19-b34d-6803e534e859 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:31.520128 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-88e7ffb8-0963-4a19-b34d-6803e534e859 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:31.529189 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-88e7ffb8-0963-4a19-b34d-6803e534e859 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:31.529680 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-88e7ffb8-0963-4a19-b34d-6803e534e859 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:31.530123 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-88e7ffb8-0963-4a19-b34d-6803e534e859 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:31.530917 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-88e7ffb8-0963-4a19-b34d-6803e534e859 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:31.531376 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-88e7ffb8-0963-4a19-b34d-6803e534e859 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:31.531806 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-88e7ffb8-0963-4a19-b34d-6803e534e859 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:31.686762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-88e7ffb8-0963-4a19-b34d-6803e534e859 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:31.694985 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-88e7ffb8-0963-4a19-b34d-6803e534e859 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.179934 Aug 08 16:56:31.695584 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 289/559] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:31 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:32.460618 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-baa58cbb-b719-4c29-9889-56a1ee0e8d51 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:56:32.461235 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-baa58cbb-b719-4c29-9889-56a1ee0e8d51 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:32.468637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-baa58cbb-b719-4c29-9889-56a1ee0e8d51 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:32.469132 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-baa58cbb-b719-4c29-9889-56a1ee0e8d51 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:32.469563 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-baa58cbb-b719-4c29-9889-56a1ee0e8d51 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:32.470287 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-baa58cbb-b719-4c29-9889-56a1ee0e8d51 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:32.470784 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-baa58cbb-b719-4c29-9889-56a1ee0e8d51 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:32.471263 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-baa58cbb-b719-4c29-9889-56a1ee0e8d51 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:32.496026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-baa58cbb-b719-4c29-9889-56a1ee0e8d51 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lazy-loading 'flavor' on Instance uuid f70c7402-29f3-48b0-b5fc-dd586f6e4266 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:56:32.718265 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e4792bda-7add-40f3-883e-be9ec4db5064 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:32.719142 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e4792bda-7add-40f3-883e-be9ec4db5064 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:32.725736 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4792bda-7add-40f3-883e-be9ec4db5064 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:32.726233 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4792bda-7add-40f3-883e-be9ec4db5064 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:32.726704 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4792bda-7add-40f3-883e-be9ec4db5064 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:32.727412 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4792bda-7add-40f3-883e-be9ec4db5064 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:32.727865 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4792bda-7add-40f3-883e-be9ec4db5064 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:32.728316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4792bda-7add-40f3-883e-be9ec4db5064 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:32.890316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e4792bda-7add-40f3-883e-be9ec4db5064 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:32.899202 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e4792bda-7add-40f3-883e-be9ec4db5064 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.185272 Aug 08 16:56:32.899796 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 290/560] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:32 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:33.115671 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-baa58cbb-b719-4c29-9889-56a1ee0e8d51 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "POST /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/action" status: 202 len: 0 microversion: 2.20 time: 0.659228 Aug 08 16:56:33.116343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 271/561] 10.222.0.13 () {62 vars in 1319 bytes} [Mon Aug 8 16:56:32 2022] POST /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 16:56:33.130037 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-48bb5ed2-b035-49cc-bbd6-6f508ce2b603 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:33.131294 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-48bb5ed2-b035-49cc-bbd6-6f508ce2b603 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:33.141676 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-48bb5ed2-b035-49cc-bbd6-6f508ce2b603 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:33.142234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-48bb5ed2-b035-49cc-bbd6-6f508ce2b603 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:33.142780 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-48bb5ed2-b035-49cc-bbd6-6f508ce2b603 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:33.143789 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-48bb5ed2-b035-49cc-bbd6-6f508ce2b603 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:33.144286 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-48bb5ed2-b035-49cc-bbd6-6f508ce2b603 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:33.144716 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-48bb5ed2-b035-49cc-bbd6-6f508ce2b603 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:33.311382 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-48bb5ed2-b035-49cc-bbd6-6f508ce2b603 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:33.320321 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-48bb5ed2-b035-49cc-bbd6-6f508ce2b603 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:33.321872 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-48bb5ed2-b035-49cc-bbd6-6f508ce2b603 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:33.323990 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-48bb5ed2-b035-49cc-bbd6-6f508ce2b603 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.200627 Aug 08 16:56:33.324596 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 291/562] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:33 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:33.922266 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-215600e7-7e72-46b1-b879-237320fa2f0f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:33.923487 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-215600e7-7e72-46b1-b879-237320fa2f0f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:33.930837 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-215600e7-7e72-46b1-b879-237320fa2f0f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:33.931459 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-215600e7-7e72-46b1-b879-237320fa2f0f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:33.931956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-215600e7-7e72-46b1-b879-237320fa2f0f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:33.932815 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-215600e7-7e72-46b1-b879-237320fa2f0f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:33.933575 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-215600e7-7e72-46b1-b879-237320fa2f0f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:33.934418 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-215600e7-7e72-46b1-b879-237320fa2f0f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:34.106774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-215600e7-7e72-46b1-b879-237320fa2f0f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:34.114850 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-215600e7-7e72-46b1-b879-237320fa2f0f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.197641 Aug 08 16:56:34.115454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 272/563] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:33 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:34.358395 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9b95e25d-2691-4fa9-b2a6-0b61d37cb99f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:34.359589 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9b95e25d-2691-4fa9-b2a6-0b61d37cb99f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:34.372820 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9b95e25d-2691-4fa9-b2a6-0b61d37cb99f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:34.373676 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9b95e25d-2691-4fa9-b2a6-0b61d37cb99f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:34.374515 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9b95e25d-2691-4fa9-b2a6-0b61d37cb99f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:34.375805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9b95e25d-2691-4fa9-b2a6-0b61d37cb99f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:34.376651 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9b95e25d-2691-4fa9-b2a6-0b61d37cb99f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:34.377416 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9b95e25d-2691-4fa9-b2a6-0b61d37cb99f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:34.555795 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9b95e25d-2691-4fa9-b2a6-0b61d37cb99f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:34.565433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9b95e25d-2691-4fa9-b2a6-0b61d37cb99f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:34.566987 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9b95e25d-2691-4fa9-b2a6-0b61d37cb99f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:34.568190 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9b95e25d-2691-4fa9-b2a6-0b61d37cb99f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.218195 Aug 08 16:56:34.569015 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 292/564] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:34 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:35.154245 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-396cfecf-e5d6-4630-9faa-2dd145e1f14b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:35.154908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-396cfecf-e5d6-4630-9faa-2dd145e1f14b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:35.162112 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-396cfecf-e5d6-4630-9faa-2dd145e1f14b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:35.162804 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-396cfecf-e5d6-4630-9faa-2dd145e1f14b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:35.163246 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-396cfecf-e5d6-4630-9faa-2dd145e1f14b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:35.163965 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-396cfecf-e5d6-4630-9faa-2dd145e1f14b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:35.164421 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-396cfecf-e5d6-4630-9faa-2dd145e1f14b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:35.164847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-396cfecf-e5d6-4630-9faa-2dd145e1f14b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:35.321707 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-396cfecf-e5d6-4630-9faa-2dd145e1f14b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:35.330892 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-396cfecf-e5d6-4630-9faa-2dd145e1f14b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1358 microversion: 2.1 time: 0.182235 Aug 08 16:56:35.331494 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 273/565] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:35 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:35.593696 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-17918050-4e40-47ce-8942-75440d21713b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:35.594557 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-17918050-4e40-47ce-8942-75440d21713b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:35.601604 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-17918050-4e40-47ce-8942-75440d21713b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:35.602603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-17918050-4e40-47ce-8942-75440d21713b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:35.603152 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-17918050-4e40-47ce-8942-75440d21713b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:35.604078 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-17918050-4e40-47ce-8942-75440d21713b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:35.605385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-17918050-4e40-47ce-8942-75440d21713b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:35.606015 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-17918050-4e40-47ce-8942-75440d21713b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:35.779304 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-17918050-4e40-47ce-8942-75440d21713b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:35.795595 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-17918050-4e40-47ce-8942-75440d21713b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:35.798887 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-17918050-4e40-47ce-8942-75440d21713b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:35.801159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-17918050-4e40-47ce-8942-75440d21713b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.212123 Aug 08 16:56:35.802200 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 293/566] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:35 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:36.354761 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1ff8e5b4-3255-420a-a7aa-74afff183b75 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:36.355412 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1ff8e5b4-3255-420a-a7aa-74afff183b75 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:36.362920 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ff8e5b4-3255-420a-a7aa-74afff183b75 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:36.363452 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ff8e5b4-3255-420a-a7aa-74afff183b75 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:36.363892 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ff8e5b4-3255-420a-a7aa-74afff183b75 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:36.364614 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ff8e5b4-3255-420a-a7aa-74afff183b75 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:36.365069 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ff8e5b4-3255-420a-a7aa-74afff183b75 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:36.365493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ff8e5b4-3255-420a-a7aa-74afff183b75 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:36.581450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1ff8e5b4-3255-420a-a7aa-74afff183b75 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:36.590777 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1ff8e5b4-3255-420a-a7aa-74afff183b75 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1547 microversion: 2.1 time: 0.241076 Aug 08 16:56:36.591393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 274/567] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:36 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1547 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:36.613295 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4402e274-e4e8-48b0-834f-73f63e20db49 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:36.613992 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4402e274-e4e8-48b0-834f-73f63e20db49 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:36.623469 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4402e274-e4e8-48b0-834f-73f63e20db49 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:36.625748 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4402e274-e4e8-48b0-834f-73f63e20db49 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:36.625748 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4402e274-e4e8-48b0-834f-73f63e20db49 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:36.625748 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4402e274-e4e8-48b0-834f-73f63e20db49 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:36.626212 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4402e274-e4e8-48b0-834f-73f63e20db49 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:36.626212 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4402e274-e4e8-48b0-834f-73f63e20db49 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:36.804846 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4402e274-e4e8-48b0-834f-73f63e20db49 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:36.819474 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4402e274-e4e8-48b0-834f-73f63e20db49 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1547 microversion: 2.1 time: 0.209612 Aug 08 16:56:36.822179 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 294/568] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:36 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1547 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:36.846101 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-140a51fc-5289-4908-9e51-07c5a790b51b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:36.846983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4a345029-8954-40b1-a3ad-add609c3c0d1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:36.847691 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4a345029-8954-40b1-a3ad-add609c3c0d1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:36.855487 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a345029-8954-40b1-a3ad-add609c3c0d1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:36.855768 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-140a51fc-5289-4908-9e51-07c5a790b51b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:36.855969 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a345029-8954-40b1-a3ad-add609c3c0d1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:36.856667 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a345029-8954-40b1-a3ad-add609c3c0d1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:36.856878 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-140a51fc-5289-4908-9e51-07c5a790b51b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Searching by: {'deleted': False, 'project_id': '236c710547184e33b1b14a88402fb363'} {{(pid=130235) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 08 16:56:36.857324 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a345029-8954-40b1-a3ad-add609c3c0d1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:36.857782 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a345029-8954-40b1-a3ad-add609c3c0d1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:36.858206 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a345029-8954-40b1-a3ad-add609c3c0d1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:36.858988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=46 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:56:36.867653 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-140a51fc-5289-4908-9e51-07c5a790b51b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:36.868493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-140a51fc-5289-4908-9e51-07c5a790b51b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:36.869272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-140a51fc-5289-4908-9e51-07c5a790b51b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:36.871319 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-140a51fc-5289-4908-9e51-07c5a790b51b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:36.872133 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-140a51fc-5289-4908-9e51-07c5a790b51b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:36.873069 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-140a51fc-5289-4908-9e51-07c5a790b51b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:37.024714 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4a345029-8954-40b1-a3ad-add609c3c0d1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:37.034843 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4a345029-8954-40b1-a3ad-add609c3c0d1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:37.036361 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4a345029-8954-40b1-a3ad-add609c3c0d1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:37.037558 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4a345029-8954-40b1-a3ad-add609c3c0d1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.195316 Aug 08 16:56:37.038139 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 295/569] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:36 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:56:37.064127 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.multi_cell_list [None req-140a51fc-5289-4908-9e51-07c5a790b51b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130235) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 08 16:56:37.258796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-140a51fc-5289-4908-9e51-07c5a790b51b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.420119 Aug 08 16:56:37.259828 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 275/570] 10.222.0.13 () {58 vars in 1125 bytes} [Mon Aug 8 16:56:36 2022] GET /compute/v2.1/servers => generated 342 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:56:37.276950 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7136ee57-52fb-4e5a-969f-039288cfc3e3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:37.277567 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7136ee57-52fb-4e5a-969f-039288cfc3e3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:37.284181 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7136ee57-52fb-4e5a-969f-039288cfc3e3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:37.284674 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7136ee57-52fb-4e5a-969f-039288cfc3e3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:37.285113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7136ee57-52fb-4e5a-969f-039288cfc3e3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:37.285829 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7136ee57-52fb-4e5a-969f-039288cfc3e3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:37.286286 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7136ee57-52fb-4e5a-969f-039288cfc3e3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:37.286753 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7136ee57-52fb-4e5a-969f-039288cfc3e3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:37.461239 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7136ee57-52fb-4e5a-969f-039288cfc3e3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:37.475837 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7136ee57-52fb-4e5a-969f-039288cfc3e3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1547 microversion: 2.1 time: 0.202451 Aug 08 16:56:37.477004 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 296/571] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:37 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1547 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:38.070482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0fdf7403-8b2d-4c7e-9d6b-b6da31b87d0d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:38.070482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0fdf7403-8b2d-4c7e-9d6b-b6da31b87d0d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:38.078792 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0fdf7403-8b2d-4c7e-9d6b-b6da31b87d0d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:38.079478 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0fdf7403-8b2d-4c7e-9d6b-b6da31b87d0d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:38.080045 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0fdf7403-8b2d-4c7e-9d6b-b6da31b87d0d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:38.080862 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0fdf7403-8b2d-4c7e-9d6b-b6da31b87d0d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:38.081378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0fdf7403-8b2d-4c7e-9d6b-b6da31b87d0d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:38.082009 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0fdf7403-8b2d-4c7e-9d6b-b6da31b87d0d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:38.245396 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0fdf7403-8b2d-4c7e-9d6b-b6da31b87d0d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:38.254791 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0fdf7403-8b2d-4c7e-9d6b-b6da31b87d0d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:38.257614 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0fdf7403-8b2d-4c7e-9d6b-b6da31b87d0d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:38.259768 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0fdf7403-8b2d-4c7e-9d6b-b6da31b87d0d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.199969 Aug 08 16:56:38.261405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 276/572] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:38 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:56:39.298584 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-caadd13a-95ab-4061-89ce-aef6ac89acb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:39.299293 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-caadd13a-95ab-4061-89ce-aef6ac89acb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:39.306469 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-caadd13a-95ab-4061-89ce-aef6ac89acb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:39.307009 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-caadd13a-95ab-4061-89ce-aef6ac89acb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:39.308079 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-caadd13a-95ab-4061-89ce-aef6ac89acb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:39.309045 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-caadd13a-95ab-4061-89ce-aef6ac89acb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:39.309582 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-caadd13a-95ab-4061-89ce-aef6ac89acb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:39.310053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-caadd13a-95ab-4061-89ce-aef6ac89acb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:39.486664 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-caadd13a-95ab-4061-89ce-aef6ac89acb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:39.500333 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-caadd13a-95ab-4061-89ce-aef6ac89acb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:39.503393 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-caadd13a-95ab-4061-89ce-aef6ac89acb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:39.505493 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-caadd13a-95ab-4061-89ce-aef6ac89acb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.211101 Aug 08 16:56:39.506448 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 297/573] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:39 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:40.548315 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-148b3148-32b6-439a-a6e7-dc638fb00705 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:40.548878 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-148b3148-32b6-439a-a6e7-dc638fb00705 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:40.556540 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-148b3148-32b6-439a-a6e7-dc638fb00705 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:40.557114 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-148b3148-32b6-439a-a6e7-dc638fb00705 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:40.558351 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-148b3148-32b6-439a-a6e7-dc638fb00705 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:40.559144 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-148b3148-32b6-439a-a6e7-dc638fb00705 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:40.559605 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-148b3148-32b6-439a-a6e7-dc638fb00705 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:40.560041 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-148b3148-32b6-439a-a6e7-dc638fb00705 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:40.749682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-148b3148-32b6-439a-a6e7-dc638fb00705 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:40.758648 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-148b3148-32b6-439a-a6e7-dc638fb00705 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:40.760816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-148b3148-32b6-439a-a6e7-dc638fb00705 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:40.762527 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-148b3148-32b6-439a-a6e7-dc638fb00705 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.218450 Aug 08 16:56:40.763147 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 277/574] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:40 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:41.787311 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-812395dc-db0b-410f-9429-4f25619fcd50 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:41.787910 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-812395dc-db0b-410f-9429-4f25619fcd50 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:41.795888 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-812395dc-db0b-410f-9429-4f25619fcd50 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:41.796379 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-812395dc-db0b-410f-9429-4f25619fcd50 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:41.797342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-812395dc-db0b-410f-9429-4f25619fcd50 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:41.797595 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-812395dc-db0b-410f-9429-4f25619fcd50 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:41.798007 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-812395dc-db0b-410f-9429-4f25619fcd50 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:41.798425 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-812395dc-db0b-410f-9429-4f25619fcd50 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:41.984433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-812395dc-db0b-410f-9429-4f25619fcd50 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:42.000530 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-812395dc-db0b-410f-9429-4f25619fcd50 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:42.003801 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-812395dc-db0b-410f-9429-4f25619fcd50 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:42.006003 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-812395dc-db0b-410f-9429-4f25619fcd50 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.222670 Aug 08 16:56:42.007181 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 298/575] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:41 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:42.097941 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-564136039", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "networks": [{"uuid": "8c35df72-56dc-4455-b640-f40dccc55f96"}]}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:56:42.157803 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.network.neutron [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] validate_networks() for [('8c35df72-56dc-4455-b640-f40dccc55f96', None, None, None, None, None)] {{(pid=130235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:56:42.813494 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Flavor limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:56:42.814208 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Image limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:56:42.815068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Flavor pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:56:42.816059 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Image pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:56:42.816705 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:56:42.828200 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:42.828699 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:42.829136 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:42.829884 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:42.830339 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:42.830950 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:42.856313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Getting quotas for project 49844b73a63b4c338fc5109f70ba774e. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:56:42.864595 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Getting quotas for user 683bed0160e54791a8e638523ac7e460 and project 49844b73a63b4c338fc5109f70ba774e. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:56:42.870470 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7e4da15c-9835-4fb5-9e7d-70bbfdb6cde2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "917bd779-92cd-49b4-9b7e-053f9b3627a4"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:56:42.873181 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7e4da15c-9835-4fb5-9e7d-70bbfdb6cde2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:42.880339 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7e4da15c-9835-4fb5-9e7d-70bbfdb6cde2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:42.880834 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7e4da15c-9835-4fb5-9e7d-70bbfdb6cde2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:42.881283 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7e4da15c-9835-4fb5-9e7d-70bbfdb6cde2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:42.882011 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7e4da15c-9835-4fb5-9e7d-70bbfdb6cde2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:42.882192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Going to run 1 instances... {{(pid=130235) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:56:42.882474 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7e4da15c-9835-4fb5-9e7d-70bbfdb6cde2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:42.882943 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7e4da15c-9835-4fb5-9e7d-70bbfdb6cde2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:42.884550 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:56:43.016511 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e20d2836-30c8-40f5-9b31-b6c4132a4043 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.922320 Aug 08 16:56:43.018852 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 278/576] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:56:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 16:56:43.035948 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5d212ecf-f9b1-4f96-830d-f901acff9b21 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:43.036574 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5d212ecf-f9b1-4f96-830d-f901acff9b21 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:43.123064 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5d212ecf-f9b1-4f96-830d-f901acff9b21 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:43.130534 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5d212ecf-f9b1-4f96-830d-f901acff9b21 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1218 microversion: 2.1 time: 0.100570 Aug 08 16:56:43.131428 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 279/577] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:43 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:43.135795 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:56:43.141777 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3910f4d7-db45-4657-a761-1c6773c7e0a4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:43.141777 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-3910f4d7-db45-4657-a761-1c6773c7e0a4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:43.145200 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3910f4d7-db45-4657-a761-1c6773c7e0a4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:43.145716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3910f4d7-db45-4657-a761-1c6773c7e0a4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:43.146344 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3910f4d7-db45-4657-a761-1c6773c7e0a4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:43.147307 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3910f4d7-db45-4657-a761-1c6773c7e0a4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:43.147957 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3910f4d7-db45-4657-a761-1c6773c7e0a4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:43.148383 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3910f4d7-db45-4657-a761-1c6773c7e0a4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:43.355169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-3910f4d7-db45-4657-a761-1c6773c7e0a4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:43.371676 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-3910f4d7-db45-4657-a761-1c6773c7e0a4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:43.374762 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-3910f4d7-db45-4657-a761-1c6773c7e0a4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:43.377034 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-3910f4d7-db45-4657-a761-1c6773c7e0a4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.244018 Aug 08 16:56:43.378038 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 280/578] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:43 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:43.820938 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7e4da15c-9835-4fb5-9e7d-70bbfdb6cde2 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "POST /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.954618 Aug 08 16:56:43.821651 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 299/579] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 16:56:42 2022] POST /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments => generated 194 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:56:44.162731 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-df68d783-5191-478f-a120-e46b55cf0e93 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:44.163376 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-df68d783-5191-478f-a120-e46b55cf0e93 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:44.171040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-df68d783-5191-478f-a120-e46b55cf0e93 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:44.171662 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-df68d783-5191-478f-a120-e46b55cf0e93 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:44.172193 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-df68d783-5191-478f-a120-e46b55cf0e93 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:44.173015 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-df68d783-5191-478f-a120-e46b55cf0e93 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:44.173597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-df68d783-5191-478f-a120-e46b55cf0e93 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:44.174348 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-df68d783-5191-478f-a120-e46b55cf0e93 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:44.254178 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-df68d783-5191-478f-a120-e46b55cf0e93 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:44.263134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-df68d783-5191-478f-a120-e46b55cf0e93 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1222 microversion: 2.1 time: 0.104955 Aug 08 16:56:44.263914 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 281/580] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:44 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1222 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:44.418794 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c3e2c2b3-e4d6-4801-a71a-1a5f0a19d919 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:44.419552 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c3e2c2b3-e4d6-4801-a71a-1a5f0a19d919 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:44.426645 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c3e2c2b3-e4d6-4801-a71a-1a5f0a19d919 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:44.429909 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c3e2c2b3-e4d6-4801-a71a-1a5f0a19d919 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:44.429909 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c3e2c2b3-e4d6-4801-a71a-1a5f0a19d919 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:44.429909 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c3e2c2b3-e4d6-4801-a71a-1a5f0a19d919 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:44.429909 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c3e2c2b3-e4d6-4801-a71a-1a5f0a19d919 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:44.430442 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c3e2c2b3-e4d6-4801-a71a-1a5f0a19d919 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:44.616760 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c3e2c2b3-e4d6-4801-a71a-1a5f0a19d919 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:44.627718 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c3e2c2b3-e4d6-4801-a71a-1a5f0a19d919 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:44.629411 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c3e2c2b3-e4d6-4801-a71a-1a5f0a19d919 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:44.630902 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c3e2c2b3-e4d6-4801-a71a-1a5f0a19d919 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.217192 Aug 08 16:56:44.631582 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 300/581] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:44 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:56:45.289403 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8e7b98b9-2a04-4d2f-925e-a8bb46ace486 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:45.290401 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8e7b98b9-2a04-4d2f-925e-a8bb46ace486 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:45.302401 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e7b98b9-2a04-4d2f-925e-a8bb46ace486 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:45.303268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e7b98b9-2a04-4d2f-925e-a8bb46ace486 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:45.304036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e7b98b9-2a04-4d2f-925e-a8bb46ace486 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:45.305276 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e7b98b9-2a04-4d2f-925e-a8bb46ace486 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:45.306079 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e7b98b9-2a04-4d2f-925e-a8bb46ace486 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:45.306913 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e7b98b9-2a04-4d2f-925e-a8bb46ace486 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:45.383100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8e7b98b9-2a04-4d2f-925e-a8bb46ace486 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:45.392041 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8e7b98b9-2a04-4d2f-925e-a8bb46ace486 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1270 microversion: 2.1 time: 0.110115 Aug 08 16:56:45.392706 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 282/582] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:45 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:45.659983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fac5407c-01b1-40e0-8617-17513cc49b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:45.660928 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fac5407c-01b1-40e0-8617-17513cc49b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:45.669010 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fac5407c-01b1-40e0-8617-17513cc49b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:45.669585 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fac5407c-01b1-40e0-8617-17513cc49b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:45.670313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fac5407c-01b1-40e0-8617-17513cc49b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:45.671424 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fac5407c-01b1-40e0-8617-17513cc49b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:45.671997 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fac5407c-01b1-40e0-8617-17513cc49b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:45.672681 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fac5407c-01b1-40e0-8617-17513cc49b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:45.925826 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fac5407c-01b1-40e0-8617-17513cc49b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:45.936927 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fac5407c-01b1-40e0-8617-17513cc49b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:45.938534 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fac5407c-01b1-40e0-8617-17513cc49b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:45.941188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fac5407c-01b1-40e0-8617-17513cc49b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.284008 Aug 08 16:56:45.951327 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 301/583] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:45 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:56:46.415571 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-250d8143-1e5a-4bf4-9a3d-a305ac1b9212 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:46.423435 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-250d8143-1e5a-4bf4-9a3d-a305ac1b9212 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:46.425417 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-250d8143-1e5a-4bf4-9a3d-a305ac1b9212 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:46.426088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-250d8143-1e5a-4bf4-9a3d-a305ac1b9212 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:46.426899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-250d8143-1e5a-4bf4-9a3d-a305ac1b9212 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:46.427775 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-250d8143-1e5a-4bf4-9a3d-a305ac1b9212 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:46.428366 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-250d8143-1e5a-4bf4-9a3d-a305ac1b9212 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:46.428870 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-250d8143-1e5a-4bf4-9a3d-a305ac1b9212 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:46.821471 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-250d8143-1e5a-4bf4-9a3d-a305ac1b9212 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:46.824476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:56:46.831881 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-250d8143-1e5a-4bf4-9a3d-a305ac1b9212 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1318 microversion: 2.1 time: 0.421483 Aug 08 16:56:46.832957 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 283/584] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:46 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:46.968203 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-333522bb-ca3f-486b-b899-6a6f14e79a00 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:46.969391 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-333522bb-ca3f-486b-b899-6a6f14e79a00 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:46.983255 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-333522bb-ca3f-486b-b899-6a6f14e79a00 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:46.984425 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-333522bb-ca3f-486b-b899-6a6f14e79a00 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:46.985309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-333522bb-ca3f-486b-b899-6a6f14e79a00 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:46.986694 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-333522bb-ca3f-486b-b899-6a6f14e79a00 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:46.987550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-333522bb-ca3f-486b-b899-6a6f14e79a00 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:46.988352 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-333522bb-ca3f-486b-b899-6a6f14e79a00 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:47.416356 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-333522bb-ca3f-486b-b899-6a6f14e79a00 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:47.425518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-333522bb-ca3f-486b-b899-6a6f14e79a00 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:47.427140 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-333522bb-ca3f-486b-b899-6a6f14e79a00 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:47.428385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-333522bb-ca3f-486b-b899-6a6f14e79a00 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.468377 Aug 08 16:56:47.428974 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 302/585] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:46 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:47.860048 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3163c00d-9406-48c4-b1b6-2e68ef212ca6 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:47.860701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-3163c00d-9406-48c4-b1b6-2e68ef212ca6 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:47.868551 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3163c00d-9406-48c4-b1b6-2e68ef212ca6 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:47.869052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3163c00d-9406-48c4-b1b6-2e68ef212ca6 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:47.869992 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3163c00d-9406-48c4-b1b6-2e68ef212ca6 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:47.870795 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3163c00d-9406-48c4-b1b6-2e68ef212ca6 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:47.871268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3163c00d-9406-48c4-b1b6-2e68ef212ca6 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:47.871697 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3163c00d-9406-48c4-b1b6-2e68ef212ca6 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:47.898014 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-4cd5fa19-0c5f-4288-a67c-ce2672cd218c req-e446ccbc-7a83-43a8-9b87-ae19740ada7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00980f58-f4e7-4ca4-9f21-d8d665401320", "tag": "b7424995-46e4-4c29-8e59-ff263dfa8afd"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:56:47.917961 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-4cd5fa19-0c5f-4288-a67c-ce2672cd218c req-e446ccbc-7a83-43a8-9b87-ae19740ada7a service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:47.919279 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-4cd5fa19-0c5f-4288-a67c-ce2672cd218c req-e446ccbc-7a83-43a8-9b87-ae19740ada7a service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:47.920292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-4cd5fa19-0c5f-4288-a67c-ce2672cd218c req-e446ccbc-7a83-43a8-9b87-ae19740ada7a service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:47.944876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-4cd5fa19-0c5f-4288-a67c-ce2672cd218c req-e446ccbc-7a83-43a8-9b87-ae19740ada7a service nova] Creating event network-changed:b7424995-46e4-4c29-8e59-ff263dfa8afd for instance 00980f58-f4e7-4ca4-9f21-d8d665401320 on hv-cinder-85220 Aug 08 16:56:47.956818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-4cd5fa19-0c5f-4288-a67c-ce2672cd218c req-e446ccbc-7a83-43a8-9b87-ae19740ada7a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071348 Aug 08 16:56:47.957450 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 303/586] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:56:48.073557 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-3163c00d-9406-48c4-b1b6-2e68ef212ca6 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:48.085097 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-3163c00d-9406-48c4-b1b6-2e68ef212ca6 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1318 microversion: 2.1 time: 0.228929 Aug 08 16:56:48.085988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 284/587] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:47 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:48.469894 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d662be6e-5621-410b-9e12-a9744f875ff2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:48.470548 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d662be6e-5621-410b-9e12-a9744f875ff2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:48.479883 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d662be6e-5621-410b-9e12-a9744f875ff2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:48.480616 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d662be6e-5621-410b-9e12-a9744f875ff2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:48.481128 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d662be6e-5621-410b-9e12-a9744f875ff2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:48.481953 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d662be6e-5621-410b-9e12-a9744f875ff2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:48.482726 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d662be6e-5621-410b-9e12-a9744f875ff2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:48.483761 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d662be6e-5621-410b-9e12-a9744f875ff2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:48.707910 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d662be6e-5621-410b-9e12-a9744f875ff2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:48.717386 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d662be6e-5621-410b-9e12-a9744f875ff2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:48.719114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d662be6e-5621-410b-9e12-a9744f875ff2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:48.720398 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d662be6e-5621-410b-9e12-a9744f875ff2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.255376 Aug 08 16:56:48.721149 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 304/588] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:48 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:49.108924 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-11d17cf6-69f7-45d3-ad8b-7d7af27ab745 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:49.109552 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-11d17cf6-69f7-45d3-ad8b-7d7af27ab745 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:49.117706 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11d17cf6-69f7-45d3-ad8b-7d7af27ab745 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:49.118251 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11d17cf6-69f7-45d3-ad8b-7d7af27ab745 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:49.118862 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11d17cf6-69f7-45d3-ad8b-7d7af27ab745 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:49.120298 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11d17cf6-69f7-45d3-ad8b-7d7af27ab745 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:49.120871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11d17cf6-69f7-45d3-ad8b-7d7af27ab745 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:49.121442 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11d17cf6-69f7-45d3-ad8b-7d7af27ab745 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:49.279687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-11d17cf6-69f7-45d3-ad8b-7d7af27ab745 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:49.287799 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-11d17cf6-69f7-45d3-ad8b-7d7af27ab745 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1318 microversion: 2.1 time: 0.183770 Aug 08 16:56:49.288404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 285/589] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:49 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:49.763252 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-612876bc-0e5f-42f8-a677-ca73f0db9f3f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:49.763867 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-612876bc-0e5f-42f8-a677-ca73f0db9f3f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:49.771556 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-612876bc-0e5f-42f8-a677-ca73f0db9f3f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:49.772053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-612876bc-0e5f-42f8-a677-ca73f0db9f3f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:49.772494 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-612876bc-0e5f-42f8-a677-ca73f0db9f3f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:49.773287 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-612876bc-0e5f-42f8-a677-ca73f0db9f3f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:49.773753 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-612876bc-0e5f-42f8-a677-ca73f0db9f3f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:49.774188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-612876bc-0e5f-42f8-a677-ca73f0db9f3f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:49.950921 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-612876bc-0e5f-42f8-a677-ca73f0db9f3f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:49.966038 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-612876bc-0e5f-42f8-a677-ca73f0db9f3f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:49.968883 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-612876bc-0e5f-42f8-a677-ca73f0db9f3f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:49.970699 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-612876bc-0e5f-42f8-a677-ca73f0db9f3f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.212142 Aug 08 16:56:49.971510 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 305/590] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:49 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:50.309451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d26968b2-c2fa-4f32-a875-e14ce8e9fa4a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:50.310306 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d26968b2-c2fa-4f32-a875-e14ce8e9fa4a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:50.318097 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d26968b2-c2fa-4f32-a875-e14ce8e9fa4a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:50.319140 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d26968b2-c2fa-4f32-a875-e14ce8e9fa4a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:50.319815 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d26968b2-c2fa-4f32-a875-e14ce8e9fa4a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:50.320622 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d26968b2-c2fa-4f32-a875-e14ce8e9fa4a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:50.321245 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d26968b2-c2fa-4f32-a875-e14ce8e9fa4a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:50.321772 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d26968b2-c2fa-4f32-a875-e14ce8e9fa4a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:50.491831 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d26968b2-c2fa-4f32-a875-e14ce8e9fa4a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:50.500650 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d26968b2-c2fa-4f32-a875-e14ce8e9fa4a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1318 microversion: 2.1 time: 0.195278 Aug 08 16:56:50.501245 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 286/591] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:50 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:50.994847 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d09aac45-7faf-4e25-ab98-acb5115ccf5e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:50.995789 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d09aac45-7faf-4e25-ab98-acb5115ccf5e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:51.002368 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d09aac45-7faf-4e25-ab98-acb5115ccf5e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:51.002917 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d09aac45-7faf-4e25-ab98-acb5115ccf5e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:51.003356 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d09aac45-7faf-4e25-ab98-acb5115ccf5e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:51.004066 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d09aac45-7faf-4e25-ab98-acb5115ccf5e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:51.004524 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d09aac45-7faf-4e25-ab98-acb5115ccf5e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:51.004952 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d09aac45-7faf-4e25-ab98-acb5115ccf5e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:51.157024 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d09aac45-7faf-4e25-ab98-acb5115ccf5e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:51.167656 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d09aac45-7faf-4e25-ab98-acb5115ccf5e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:51.169337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d09aac45-7faf-4e25-ab98-acb5115ccf5e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:51.170530 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d09aac45-7faf-4e25-ab98-acb5115ccf5e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.179895 Aug 08 16:56:51.171129 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 306/592] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:50 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:56:51.521099 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fd8edd8d-69b1-452f-9886-f225b666b30b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:51.521717 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fd8edd8d-69b1-452f-9886-f225b666b30b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:51.528665 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd8edd8d-69b1-452f-9886-f225b666b30b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:51.529153 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd8edd8d-69b1-452f-9886-f225b666b30b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:51.529588 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd8edd8d-69b1-452f-9886-f225b666b30b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:51.530307 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd8edd8d-69b1-452f-9886-f225b666b30b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:51.530797 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd8edd8d-69b1-452f-9886-f225b666b30b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:51.531224 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd8edd8d-69b1-452f-9886-f225b666b30b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:51.678836 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fd8edd8d-69b1-452f-9886-f225b666b30b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:51.688478 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fd8edd8d-69b1-452f-9886-f225b666b30b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1318 microversion: 2.1 time: 0.171175 Aug 08 16:56:51.689069 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 287/593] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:51 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:52.193958 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7687574e-65f8-4ea6-a5c3-1630ccaab307 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:52.194645 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7687574e-65f8-4ea6-a5c3-1630ccaab307 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:52.201612 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7687574e-65f8-4ea6-a5c3-1630ccaab307 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:52.202109 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7687574e-65f8-4ea6-a5c3-1630ccaab307 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:52.202589 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7687574e-65f8-4ea6-a5c3-1630ccaab307 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:52.203989 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7687574e-65f8-4ea6-a5c3-1630ccaab307 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:52.203989 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7687574e-65f8-4ea6-a5c3-1630ccaab307 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:52.204266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7687574e-65f8-4ea6-a5c3-1630ccaab307 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:52.359205 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7687574e-65f8-4ea6-a5c3-1630ccaab307 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:52.367779 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7687574e-65f8-4ea6-a5c3-1630ccaab307 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:52.369975 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7687574e-65f8-4ea6-a5c3-1630ccaab307 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:52.371413 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7687574e-65f8-4ea6-a5c3-1630ccaab307 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.181939 Aug 08 16:56:52.372052 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 307/594] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:52 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:52.709828 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9bd8eb23-ae08-4094-8de9-fb3c32d38aec tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:52.710512 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9bd8eb23-ae08-4094-8de9-fb3c32d38aec tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:52.718902 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9bd8eb23-ae08-4094-8de9-fb3c32d38aec tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:52.719400 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9bd8eb23-ae08-4094-8de9-fb3c32d38aec tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:52.719834 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9bd8eb23-ae08-4094-8de9-fb3c32d38aec tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:52.720612 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9bd8eb23-ae08-4094-8de9-fb3c32d38aec tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:52.721066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9bd8eb23-ae08-4094-8de9-fb3c32d38aec tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:52.721499 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9bd8eb23-ae08-4094-8de9-fb3c32d38aec tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:52.840747 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=4 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:56:52.883109 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9bd8eb23-ae08-4094-8de9-fb3c32d38aec tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:52.896684 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9bd8eb23-ae08-4094-8de9-fb3c32d38aec tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1318 microversion: 2.1 time: 0.190709 Aug 08 16:56:52.897460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 288/595] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:52 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:53.397559 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3111b476-f1f0-43ab-be4a-e66af2e73bd2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:53.398491 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3111b476-f1f0-43ab-be4a-e66af2e73bd2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:53.407506 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3111b476-f1f0-43ab-be4a-e66af2e73bd2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:53.408162 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3111b476-f1f0-43ab-be4a-e66af2e73bd2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:53.408756 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3111b476-f1f0-43ab-be4a-e66af2e73bd2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:53.409728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3111b476-f1f0-43ab-be4a-e66af2e73bd2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:53.410358 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3111b476-f1f0-43ab-be4a-e66af2e73bd2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:53.410959 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3111b476-f1f0-43ab-be4a-e66af2e73bd2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:53.639664 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3111b476-f1f0-43ab-be4a-e66af2e73bd2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:53.649163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3111b476-f1f0-43ab-be4a-e66af2e73bd2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:53.651070 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3111b476-f1f0-43ab-be4a-e66af2e73bd2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:53.652507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3111b476-f1f0-43ab-be4a-e66af2e73bd2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.260463 Aug 08 16:56:53.653183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 308/596] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:53 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:56:53.797725 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7660be66-5d08-4345-88a0-d0668542ffa6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:53.798483 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7660be66-5d08-4345-88a0-d0668542ffa6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:53.800623 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=8 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:56:53.809561 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7660be66-5d08-4345-88a0-d0668542ffa6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:53.809561 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7660be66-5d08-4345-88a0-d0668542ffa6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:53.809561 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7660be66-5d08-4345-88a0-d0668542ffa6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:53.809561 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7660be66-5d08-4345-88a0-d0668542ffa6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:53.810150 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7660be66-5d08-4345-88a0-d0668542ffa6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:53.810150 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7660be66-5d08-4345-88a0-d0668542ffa6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:53.923344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-762413a7-1401-4b78-8ef1-4ac3f57c9375 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:53.924399 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-762413a7-1401-4b78-8ef1-4ac3f57c9375 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:53.936362 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-762413a7-1401-4b78-8ef1-4ac3f57c9375 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:53.936362 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-762413a7-1401-4b78-8ef1-4ac3f57c9375 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:53.936941 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-762413a7-1401-4b78-8ef1-4ac3f57c9375 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:53.938078 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-762413a7-1401-4b78-8ef1-4ac3f57c9375 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:53.938794 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-762413a7-1401-4b78-8ef1-4ac3f57c9375 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:53.939329 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-762413a7-1401-4b78-8ef1-4ac3f57c9375 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:53.979730 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7660be66-5d08-4345-88a0-d0668542ffa6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:53.997328 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7660be66-5d08-4345-88a0-d0668542ffa6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1593 microversion: 2.1 time: 0.203423 Aug 08 16:56:53.998446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 289/597] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:53 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1593 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:54.118035 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-762413a7-1401-4b78-8ef1-4ac3f57c9375 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:54.128914 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-762413a7-1401-4b78-8ef1-4ac3f57c9375 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1318 microversion: 2.1 time: 0.213904 Aug 08 16:56:54.136946 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 309/598] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:53 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:54.680824 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-acc45c1a-d2a2-49ab-a27d-75cd9a488286 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:54.683093 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-acc45c1a-d2a2-49ab-a27d-75cd9a488286 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:54.694820 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-acc45c1a-d2a2-49ab-a27d-75cd9a488286 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:54.695697 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-acc45c1a-d2a2-49ab-a27d-75cd9a488286 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:54.696491 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-acc45c1a-d2a2-49ab-a27d-75cd9a488286 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:54.699114 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-acc45c1a-d2a2-49ab-a27d-75cd9a488286 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:54.699886 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-acc45c1a-d2a2-49ab-a27d-75cd9a488286 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:54.700615 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-acc45c1a-d2a2-49ab-a27d-75cd9a488286 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:54.889108 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-acc45c1a-d2a2-49ab-a27d-75cd9a488286 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:54.898626 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-acc45c1a-d2a2-49ab-a27d-75cd9a488286 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:54.900395 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-acc45c1a-d2a2-49ab-a27d-75cd9a488286 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:54.901799 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-acc45c1a-d2a2-49ab-a27d-75cd9a488286 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.228120 Aug 08 16:56:54.902387 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 290/599] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:54 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:55.156167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a24e8218-eb05-44ea-82e3-4d4014984584 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:55.157225 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a24e8218-eb05-44ea-82e3-4d4014984584 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:55.166383 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a24e8218-eb05-44ea-82e3-4d4014984584 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:55.167108 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a24e8218-eb05-44ea-82e3-4d4014984584 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:55.167868 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a24e8218-eb05-44ea-82e3-4d4014984584 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:55.168742 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a24e8218-eb05-44ea-82e3-4d4014984584 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:55.169357 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a24e8218-eb05-44ea-82e3-4d4014984584 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:55.169919 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a24e8218-eb05-44ea-82e3-4d4014984584 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:55.405737 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a24e8218-eb05-44ea-82e3-4d4014984584 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:55.414528 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a24e8218-eb05-44ea-82e3-4d4014984584 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1318 microversion: 2.1 time: 0.262957 Aug 08 16:56:55.415309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 310/600] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:55 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:55.870152 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-2cafd3a6-e4ba-439d-a40a-ad4e475af8c4 req-2f425d11-9bfd-4251-98f5-31d793978730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00980f58-f4e7-4ca4-9f21-d8d665401320", "name": "network-vif-plugged", "status": "completed", "tag": "b7424995-46e4-4c29-8e59-ff263dfa8afd"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:56:55.886290 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-2cafd3a6-e4ba-439d-a40a-ad4e475af8c4 req-2f425d11-9bfd-4251-98f5-31d793978730 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:55.887572 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-2cafd3a6-e4ba-439d-a40a-ad4e475af8c4 req-2f425d11-9bfd-4251-98f5-31d793978730 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:55.888158 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-2cafd3a6-e4ba-439d-a40a-ad4e475af8c4 req-2f425d11-9bfd-4251-98f5-31d793978730 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:55.905316 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-2cafd3a6-e4ba-439d-a40a-ad4e475af8c4 req-2f425d11-9bfd-4251-98f5-31d793978730 service nova] Creating event network-vif-plugged:b7424995-46e4-4c29-8e59-ff263dfa8afd for instance 00980f58-f4e7-4ca4-9f21-d8d665401320 on hv-cinder-85220 Aug 08 16:56:55.914187 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-2cafd3a6-e4ba-439d-a40a-ad4e475af8c4 req-2f425d11-9bfd-4251-98f5-31d793978730 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049317 Aug 08 16:56:55.914806 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 291/601] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:56:55.939542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b8ede19b-c262-44c7-9092-0dd822542911 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:55.940337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b8ede19b-c262-44c7-9092-0dd822542911 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:55.948801 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8ede19b-c262-44c7-9092-0dd822542911 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:55.949644 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8ede19b-c262-44c7-9092-0dd822542911 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:55.950744 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8ede19b-c262-44c7-9092-0dd822542911 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:55.952093 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8ede19b-c262-44c7-9092-0dd822542911 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:55.952683 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8ede19b-c262-44c7-9092-0dd822542911 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:55.953329 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8ede19b-c262-44c7-9092-0dd822542911 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:56.440546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c2833b07-ab80-4243-bfaf-e8c6f1e8997b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:56.441370 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c2833b07-ab80-4243-bfaf-e8c6f1e8997b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:56.453798 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c2833b07-ab80-4243-bfaf-e8c6f1e8997b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:56.454696 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c2833b07-ab80-4243-bfaf-e8c6f1e8997b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:56.455470 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c2833b07-ab80-4243-bfaf-e8c6f1e8997b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:56.456315 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c2833b07-ab80-4243-bfaf-e8c6f1e8997b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:56.457042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c2833b07-ab80-4243-bfaf-e8c6f1e8997b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:56.457733 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c2833b07-ab80-4243-bfaf-e8c6f1e8997b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:56.631214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c2833b07-ab80-4243-bfaf-e8c6f1e8997b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:56.645170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c2833b07-ab80-4243-bfaf-e8c6f1e8997b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1318 microversion: 2.1 time: 0.210856 Aug 08 16:56:56.646183 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 292/602] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:56 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:56:56.794067 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b8ede19b-c262-44c7-9092-0dd822542911 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:56.806004 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b8ede19b-c262-44c7-9092-0dd822542911 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:56.808576 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b8ede19b-c262-44c7-9092-0dd822542911 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:56.810615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b8ede19b-c262-44c7-9092-0dd822542911 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.875612 Aug 08 16:56:56.811522 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 311/603] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:55 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:57.215616 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-1fd2ae1d-f5a8-415d-9ab8-187b0891ce1a req-87e9df0e-9d59-45c0-9fb5-8c0b79de916c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "173f1a4f-1673-4644-8730-67eaf9df2b61", "tag": "e664734d-6d99-473f-9417-434a305e356c"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:56:57.227385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-1fd2ae1d-f5a8-415d-9ab8-187b0891ce1a req-87e9df0e-9d59-45c0-9fb5-8c0b79de916c service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:57.227871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-1fd2ae1d-f5a8-415d-9ab8-187b0891ce1a req-87e9df0e-9d59-45c0-9fb5-8c0b79de916c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:57.229923 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-1fd2ae1d-f5a8-415d-9ab8-187b0891ce1a req-87e9df0e-9d59-45c0-9fb5-8c0b79de916c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:57.243023 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-1fd2ae1d-f5a8-415d-9ab8-187b0891ce1a req-87e9df0e-9d59-45c0-9fb5-8c0b79de916c service nova] Creating event network-changed:e664734d-6d99-473f-9417-434a305e356c for instance 173f1a4f-1673-4644-8730-67eaf9df2b61 on hv-cinder-85220 Aug 08 16:56:57.249629 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-1fd2ae1d-f5a8-415d-9ab8-187b0891ce1a req-87e9df0e-9d59-45c0-9fb5-8c0b79de916c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038690 Aug 08 16:56:57.253020 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 293/604] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:56:57.673696 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b8ba24a2-4a08-4ba0-bb30-953a0307224a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:57.675807 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b8ba24a2-4a08-4ba0-bb30-953a0307224a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:57.703508 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8ba24a2-4a08-4ba0-bb30-953a0307224a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:57.704496 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8ba24a2-4a08-4ba0-bb30-953a0307224a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:57.705594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8ba24a2-4a08-4ba0-bb30-953a0307224a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:57.706919 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8ba24a2-4a08-4ba0-bb30-953a0307224a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:57.707766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8ba24a2-4a08-4ba0-bb30-953a0307224a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:57.708539 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8ba24a2-4a08-4ba0-bb30-953a0307224a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:57.839897 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-54a7401d-9aa5-435e-9d0f-09e6c55cec20 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:57.841065 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-54a7401d-9aa5-435e-9d0f-09e6c55cec20 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:57.850584 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-54a7401d-9aa5-435e-9d0f-09e6c55cec20 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:57.851708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-54a7401d-9aa5-435e-9d0f-09e6c55cec20 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:57.854533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-54a7401d-9aa5-435e-9d0f-09e6c55cec20 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:57.855810 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-54a7401d-9aa5-435e-9d0f-09e6c55cec20 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:57.857147 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-54a7401d-9aa5-435e-9d0f-09e6c55cec20 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:57.857841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-54a7401d-9aa5-435e-9d0f-09e6c55cec20 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:57.963411 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b8ba24a2-4a08-4ba0-bb30-953a0307224a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:57.987593 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b8ba24a2-4a08-4ba0-bb30-953a0307224a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1318 microversion: 2.1 time: 0.321790 Aug 08 16:56:57.993099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 312/605] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:57 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:58.103573 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-54a7401d-9aa5-435e-9d0f-09e6c55cec20 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:58.120937 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-54a7401d-9aa5-435e-9d0f-09e6c55cec20 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:58.124476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-54a7401d-9aa5-435e-9d0f-09e6c55cec20 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:58.126759 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-54a7401d-9aa5-435e-9d0f-09e6c55cec20 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1744 microversion: 2.20 time: 0.294605 Aug 08 16:56:58.127791 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 294/606] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:57 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1744 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:59.025915 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b97a816d-5e83-4abb-b701-2cd440059a25 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:59.026626 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b97a816d-5e83-4abb-b701-2cd440059a25 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:59.033728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b97a816d-5e83-4abb-b701-2cd440059a25 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:59.034228 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b97a816d-5e83-4abb-b701-2cd440059a25 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:59.034711 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b97a816d-5e83-4abb-b701-2cd440059a25 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:59.035433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b97a816d-5e83-4abb-b701-2cd440059a25 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:59.036032 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b97a816d-5e83-4abb-b701-2cd440059a25 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:59.036410 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b97a816d-5e83-4abb-b701-2cd440059a25 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:59.157064 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ab97a299-3755-43b0-9dca-107c5197868c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:56:59.166351 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ab97a299-3755-43b0-9dca-107c5197868c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:56:59.169732 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab97a299-3755-43b0-9dca-107c5197868c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:59.169983 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab97a299-3755-43b0-9dca-107c5197868c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:59.170594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab97a299-3755-43b0-9dca-107c5197868c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:59.171267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab97a299-3755-43b0-9dca-107c5197868c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:59.171729 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab97a299-3755-43b0-9dca-107c5197868c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:59.172451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab97a299-3755-43b0-9dca-107c5197868c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:59.246960 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b97a816d-5e83-4abb-b701-2cd440059a25 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:59.261207 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b97a816d-5e83-4abb-b701-2cd440059a25 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1318 microversion: 2.1 time: 0.239109 Aug 08 16:56:59.262548 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 313/607] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:56:59 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:56:59.373541 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ab97a299-3755-43b0-9dca-107c5197868c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:59.389456 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ab97a299-3755-43b0-9dca-107c5197868c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:59.392954 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ab97a299-3755-43b0-9dca-107c5197868c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:56:59.395260 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ab97a299-3755-43b0-9dca-107c5197868c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1744 microversion: 2.20 time: 0.246867 Aug 08 16:56:59.396441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 295/608] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:56:59 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1744 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:56:59.784044 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-c5053f50-7f11-4f67-8916-99ba918b0d68 req-94e77071-b39d-4840-9199-1abe0f511795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70c7402-29f3-48b0-b5fc-dd586f6e4266", "name": "network-vif-plugged", "status": "completed", "tag": "ee6f4872-65bc-467b-9551-24824a3b32ad"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:56:59.802259 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-c5053f50-7f11-4f67-8916-99ba918b0d68 req-94e77071-b39d-4840-9199-1abe0f511795 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:56:59.803141 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-c5053f50-7f11-4f67-8916-99ba918b0d68 req-94e77071-b39d-4840-9199-1abe0f511795 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:56:59.803942 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-c5053f50-7f11-4f67-8916-99ba918b0d68 req-94e77071-b39d-4840-9199-1abe0f511795 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:56:59.828941 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-c5053f50-7f11-4f67-8916-99ba918b0d68 req-94e77071-b39d-4840-9199-1abe0f511795 service nova] Creating event network-vif-plugged:ee6f4872-65bc-467b-9551-24824a3b32ad for instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 on hv-cinder-85220 Aug 08 16:56:59.838660 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-c5053f50-7f11-4f67-8916-99ba918b0d68 req-94e77071-b39d-4840-9199-1abe0f511795 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064560 Aug 08 16:56:59.839784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 314/609] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:57:00.289813 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fe9dc733-76b1-43a2-8835-ad6cbc94868a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:00.290950 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fe9dc733-76b1-43a2-8835-ad6cbc94868a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:00.300365 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fe9dc733-76b1-43a2-8835-ad6cbc94868a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:00.300903 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fe9dc733-76b1-43a2-8835-ad6cbc94868a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:00.301351 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fe9dc733-76b1-43a2-8835-ad6cbc94868a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:00.302106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fe9dc733-76b1-43a2-8835-ad6cbc94868a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:00.302587 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fe9dc733-76b1-43a2-8835-ad6cbc94868a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:00.303033 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fe9dc733-76b1-43a2-8835-ad6cbc94868a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:00.426522 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-583ab79f-c3d0-40ec-a35f-848faf3377c0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:00.427840 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-583ab79f-c3d0-40ec-a35f-848faf3377c0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:00.440324 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-583ab79f-c3d0-40ec-a35f-848faf3377c0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:00.441281 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-583ab79f-c3d0-40ec-a35f-848faf3377c0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:00.442175 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-583ab79f-c3d0-40ec-a35f-848faf3377c0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:00.447803 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-583ab79f-c3d0-40ec-a35f-848faf3377c0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:00.447803 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-583ab79f-c3d0-40ec-a35f-848faf3377c0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:00.447803 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-583ab79f-c3d0-40ec-a35f-848faf3377c0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:00.474926 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fe9dc733-76b1-43a2-8835-ad6cbc94868a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:00.485175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fe9dc733-76b1-43a2-8835-ad6cbc94868a tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1507 microversion: 2.1 time: 0.202071 Aug 08 16:57:00.485875 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 296/610] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:00 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:00.490867 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-778aba44-5a2c-4244-b450-b81a83292e8c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1678905078"}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:00.494980 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-778aba44-5a2c-4244-b450-b81a83292e8c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:00.498811 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-778aba44-5a2c-4244-b450-b81a83292e8c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:00.499330 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-778aba44-5a2c-4244-b450-b81a83292e8c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:00.499789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-778aba44-5a2c-4244-b450-b81a83292e8c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:00.500531 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-778aba44-5a2c-4244-b450-b81a83292e8c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:00.500994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-778aba44-5a2c-4244-b450-b81a83292e8c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:00.501420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-778aba44-5a2c-4244-b450-b81a83292e8c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:00.658836 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-583ab79f-c3d0-40ec-a35f-848faf3377c0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:00.675976 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.network.security_group_api [None req-778aba44-5a2c-4244-b450-b81a83292e8c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Adding security group 2698715e-7877-4e27-89ab-81c6c39ec37d to port e664734d-6d99-473f-9417-434a305e356c Aug 08 16:57:00.677494 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-583ab79f-c3d0-40ec-a35f-848faf3377c0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:00.679212 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-583ab79f-c3d0-40ec-a35f-848faf3377c0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:00.682554 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-583ab79f-c3d0-40ec-a35f-848faf3377c0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.264936 Aug 08 16:57:00.682743 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 315/611] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:00 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:57:00.713037 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-285e0399-d2cf-4a36-9f50-3d8e7efb1ed9 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29f2530f-5458-4bdb-9bf9-82d579222802", "device": "/dev/sdb"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:00.717051 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-285e0399-d2cf-4a36-9f50-3d8e7efb1ed9 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:00.729353 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-285e0399-d2cf-4a36-9f50-3d8e7efb1ed9 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:00.730345 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-285e0399-d2cf-4a36-9f50-3d8e7efb1ed9 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:00.731242 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-285e0399-d2cf-4a36-9f50-3d8e7efb1ed9 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:00.732616 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-285e0399-d2cf-4a36-9f50-3d8e7efb1ed9 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:00.733508 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-285e0399-d2cf-4a36-9f50-3d8e7efb1ed9 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:00.734176 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-285e0399-d2cf-4a36-9f50-3d8e7efb1ed9 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:01.046992 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:01.234266 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-778aba44-5a2c-4244-b450-b81a83292e8c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "POST /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/action" status: 202 len: 0 microversion: 2.1 time: 0.746935 Aug 08 16:57:01.236226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 297/612] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 16:57:00 2022] POST /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/action => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:57:01.269493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9abc225b-62e6-4d2e-98f5-84be56a3750d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:01.271122 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9abc225b-62e6-4d2e-98f5-84be56a3750d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:01.292769 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9abc225b-62e6-4d2e-98f5-84be56a3750d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:01.295164 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9abc225b-62e6-4d2e-98f5-84be56a3750d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:01.297834 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9abc225b-62e6-4d2e-98f5-84be56a3750d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:01.302527 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9abc225b-62e6-4d2e-98f5-84be56a3750d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:01.302527 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9abc225b-62e6-4d2e-98f5-84be56a3750d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:01.302527 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9abc225b-62e6-4d2e-98f5-84be56a3750d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:01.621575 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9abc225b-62e6-4d2e-98f5-84be56a3750d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:01.643050 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9abc225b-62e6-4d2e-98f5-84be56a3750d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1758 microversion: 2.1 time: 0.393789 Aug 08 16:57:01.646112 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 298/613] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:01 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1758 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:01.653997 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-c7c42532-10a0-40a0-be43-2d139f34a939 req-791c3e1b-7a87-4c64-af29-9348a1219605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "173f1a4f-1673-4644-8730-67eaf9df2b61", "tag": "e664734d-6d99-473f-9417-434a305e356c"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:01.669306 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-c7c42532-10a0-40a0-be43-2d139f34a939 req-791c3e1b-7a87-4c64-af29-9348a1219605 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:01.669797 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-c7c42532-10a0-40a0-be43-2d139f34a939 req-791c3e1b-7a87-4c64-af29-9348a1219605 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:01.670239 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-c7c42532-10a0-40a0-be43-2d139f34a939 req-791c3e1b-7a87-4c64-af29-9348a1219605 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:01.684874 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-c7c42532-10a0-40a0-be43-2d139f34a939 req-791c3e1b-7a87-4c64-af29-9348a1219605 service nova] Creating event network-changed:e664734d-6d99-473f-9417-434a305e356c for instance 173f1a4f-1673-4644-8730-67eaf9df2b61 on hv-cinder-85220 Aug 08 16:57:01.688482 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-285e0399-d2cf-4a36-9f50-3d8e7efb1ed9 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "POST /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.004317 Aug 08 16:57:01.690511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 316/614] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 16:57:00 2022] POST /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320/os-volume_attachments => generated 194 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:01.692686 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-c7c42532-10a0-40a0-be43-2d139f34a939 req-791c3e1b-7a87-4c64-af29-9348a1219605 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044974 Aug 08 16:57:01.693903 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 299/615] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:01.700106 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-dfca9bb3-82fb-4250-aede-b0bab096637c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:01.729467 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-282c47c0-7a7f-44ee-843a-536241bb5458 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:01.730322 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-282c47c0-7a7f-44ee-843a-536241bb5458 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:01.734348 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-dfca9bb3-82fb-4250-aede-b0bab096637c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:01.742162 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=58 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:01.745973 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-282c47c0-7a7f-44ee-843a-536241bb5458 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:01.756424 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dfca9bb3-82fb-4250-aede-b0bab096637c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:01.761108 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dfca9bb3-82fb-4250-aede-b0bab096637c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:01.761660 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dfca9bb3-82fb-4250-aede-b0bab096637c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:01.763091 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dfca9bb3-82fb-4250-aede-b0bab096637c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:01.763629 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-282c47c0-7a7f-44ee-843a-536241bb5458 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:01.765083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-282c47c0-7a7f-44ee-843a-536241bb5458 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:01.767525 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dfca9bb3-82fb-4250-aede-b0bab096637c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:01.768870 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-282c47c0-7a7f-44ee-843a-536241bb5458 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:01.769635 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dfca9bb3-82fb-4250-aede-b0bab096637c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:01.773918 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-282c47c0-7a7f-44ee-843a-536241bb5458 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:01.780446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-282c47c0-7a7f-44ee-843a-536241bb5458 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:01.976753 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-dfca9bb3-82fb-4250-aede-b0bab096637c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lazy-loading 'services' on Instance uuid cba167d3-4013-4e79-8c84-5a72b458b6f7 {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:57:02.279167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-282c47c0-7a7f-44ee-843a-536241bb5458 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:02.299219 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-282c47c0-7a7f-44ee-843a-536241bb5458 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:02.303710 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-282c47c0-7a7f-44ee-843a-536241bb5458 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:02.307621 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-282c47c0-7a7f-44ee-843a-536241bb5458 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.585925 Aug 08 16:57:02.309012 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 300/616] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:01 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:02.360659 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-dfca9bb3-82fb-4250-aede-b0bab096637c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/os-volume_attachments/8edda708-73a1-4bb4-bad8-098005b0af9b" status: 202 len: 0 microversion: 2.1 time: 0.666014 Aug 08 16:57:02.361402 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 317/617] 10.222.0.13 () {58 vars in 1416 bytes} [Mon Aug 8 16:57:01 2022] DELETE /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/os-volume_attachments/8edda708-73a1-4bb4-bad8-098005b0af9b => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:57:03.340727 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7a0e2fb8-18ab-44b3-867b-124e0e85cc35 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:03.342349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7a0e2fb8-18ab-44b3-867b-124e0e85cc35 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:03.355350 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a0e2fb8-18ab-44b3-867b-124e0e85cc35 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:03.360551 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a0e2fb8-18ab-44b3-867b-124e0e85cc35 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:03.360551 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a0e2fb8-18ab-44b3-867b-124e0e85cc35 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:03.360551 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a0e2fb8-18ab-44b3-867b-124e0e85cc35 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:03.360551 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a0e2fb8-18ab-44b3-867b-124e0e85cc35 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:03.361132 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a0e2fb8-18ab-44b3-867b-124e0e85cc35 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:03.620018 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7a0e2fb8-18ab-44b3-867b-124e0e85cc35 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:03.632702 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2f460a60-5f8f-41fb-a134-bad4e2475b3b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fad196b8-b7c0-4baf-a7cb-e60187f87ce5"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:03.637216 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2f460a60-5f8f-41fb-a134-bad4e2475b3b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:03.645171 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2f460a60-5f8f-41fb-a134-bad4e2475b3b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:03.646288 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2f460a60-5f8f-41fb-a134-bad4e2475b3b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:03.647404 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2f460a60-5f8f-41fb-a134-bad4e2475b3b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:03.648434 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2f460a60-5f8f-41fb-a134-bad4e2475b3b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:03.649068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2f460a60-5f8f-41fb-a134-bad4e2475b3b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:03.649686 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2f460a60-5f8f-41fb-a134-bad4e2475b3b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:03.651459 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7a0e2fb8-18ab-44b3-867b-124e0e85cc35 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:03.657573 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7a0e2fb8-18ab-44b3-867b-124e0e85cc35 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:03.664138 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7a0e2fb8-18ab-44b3-867b-124e0e85cc35 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.333807 Aug 08 16:57:03.679402 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 301/618] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:03 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:04.411028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9fb65d98-ce26-4295-b786-a889bd6f5381 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:04.412568 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9fb65d98-ce26-4295-b786-a889bd6f5381 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:04.419990 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9fb65d98-ce26-4295-b786-a889bd6f5381 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:04.420791 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9fb65d98-ce26-4295-b786-a889bd6f5381 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:04.421409 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9fb65d98-ce26-4295-b786-a889bd6f5381 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:04.422382 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9fb65d98-ce26-4295-b786-a889bd6f5381 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:04.422884 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9fb65d98-ce26-4295-b786-a889bd6f5381 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:04.423328 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9fb65d98-ce26-4295-b786-a889bd6f5381 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:04.466304 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9fb65d98-ce26-4295-b786-a889bd6f5381 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448/ips" status: 200 len: 148 microversion: 2.1 time: 0.292694 Aug 08 16:57:04.467010 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 302/619] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Aug 8 16:57:04 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448/ips => generated 148 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:57:04.480099 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-230d6607-5406-48d0-b7dd-26c9131d8644 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "153a3016-da47-456e-9992-fa3763b2943f"}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:04.483390 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-230d6607-5406-48d0-b7dd-26c9131d8644 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:04.491858 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-230d6607-5406-48d0-b7dd-26c9131d8644 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:04.493164 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-230d6607-5406-48d0-b7dd-26c9131d8644 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:04.494705 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-230d6607-5406-48d0-b7dd-26c9131d8644 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:04.495727 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-230d6607-5406-48d0-b7dd-26c9131d8644 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:04.496283 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-230d6607-5406-48d0-b7dd-26c9131d8644 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:04.496794 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-230d6607-5406-48d0-b7dd-26c9131d8644 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:04.499908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=100 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:04.611539 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-230d6607-5406-48d0-b7dd-26c9131d8644 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Invalid volume: volume 153a3016-da47-456e-9992-fa3763b2943f is already attached to instances: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd Aug 08 16:57:04.616305 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2f460a60-5f8f-41fb-a134-bad4e2475b3b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "POST /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.165688 Aug 08 16:57:04.625196 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 318/620] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 16:57:03 2022] POST /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-volume_attachments => generated 194 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-230d6607-5406-48d0-b7dd-26c9131d8644 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: POST /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448/os-volume_attachments HTTP/1.1 Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 74 Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:57:04.626907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:57:04.629175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:57:04.629175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:57:04.629175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 16:57:04.629175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:57:04.629175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 16:57:04.629175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:57:04.629175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:57:04.629175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 16:57:04.629175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 16:57:04.629175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Aug 08 16:57:04.629175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {"volumeAttachment": {"volumeId": "153a3016-da47-456e-9992-fa3763b2943f"}} Aug 08 16:57:04.629175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Invalid volume: volume 153a3016-da47-456e-9992-fa3763b2943f is already attached to instances: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'server_id': '8cfbc416-d601-45f7-82e8-a6d09c30f448', 'body': {'volumeAttachment': {'volumeId': '153a3016-da47-456e-9992-fa3763b2943f'}}} Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 153a3016-da47-456e-9992-fa3763b2943f is already attached to instances: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:04.631036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 153a3016-da47-456e-9992-fa3763b2943f is already attached to instances: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:57:04.651037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:57:04.655809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:57:04.655809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:57:04.655809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:57:04.655809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 153a3016-da47-456e-9992-fa3763b2943f is already attached to instances: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd Aug 08 16:57:04.655809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:04.655809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-230d6607-5406-48d0-b7dd-26c9131d8644 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 400 to user: Invalid volume: volume 153a3016-da47-456e-9992-fa3763b2943f is already attached to instances: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:57:04.655809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-230d6607-5406-48d0-b7dd-26c9131d8644 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "POST /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.178097 Aug 08 16:57:04.659607 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 303/621] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 16:57:04 2022] POST /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448/os-volume_attachments => generated 174 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 16:57:04.670006 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1a60adf2-6e6b-4b74-837c-6123c9aea501 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:04.671494 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1a60adf2-6e6b-4b74-837c-6123c9aea501 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:04.684825 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1a60adf2-6e6b-4b74-837c-6123c9aea501 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:04.685326 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1a60adf2-6e6b-4b74-837c-6123c9aea501 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:04.685772 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1a60adf2-6e6b-4b74-837c-6123c9aea501 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:04.686615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1a60adf2-6e6b-4b74-837c-6123c9aea501 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:04.687101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1a60adf2-6e6b-4b74-837c-6123c9aea501 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:04.687541 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1a60adf2-6e6b-4b74-837c-6123c9aea501 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:04.712643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7558fea3-eaee-43e3-9add-3fda9321a0f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:04.713705 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7558fea3-eaee-43e3-9add-3fda9321a0f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:04.717475 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1a60adf2-6e6b-4b74-837c-6123c9aea501 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:57:04.727911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7558fea3-eaee-43e3-9add-3fda9321a0f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:04.728414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7558fea3-eaee-43e3-9add-3fda9321a0f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:04.728855 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7558fea3-eaee-43e3-9add-3fda9321a0f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:04.735642 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7558fea3-eaee-43e3-9add-3fda9321a0f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:04.736653 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7558fea3-eaee-43e3-9add-3fda9321a0f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:04.737897 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7558fea3-eaee-43e3-9add-3fda9321a0f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:04.982059 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7558fea3-eaee-43e3-9add-3fda9321a0f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:05.002880 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7558fea3-eaee-43e3-9add-3fda9321a0f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:05.005866 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7558fea3-eaee-43e3-9add-3fda9321a0f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:05.009763 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7558fea3-eaee-43e3-9add-3fda9321a0f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.300552 Aug 08 16:57:05.011371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 304/622] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:04 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:57:05.034048 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1a60adf2-6e6b-4b74-837c-6123c9aea501 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 204 len: 0 microversion: 2.1 time: 0.368951 Aug 08 16:57:05.036148 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 319/623] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:57:04 2022] DELETE /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 16:57:05.045412 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-441e6606-df32-4f07-8d92-a336971f2bd0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:05.046075 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-441e6606-df32-4f07-8d92-a336971f2bd0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:05.047326 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 16:57:05.052786 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Mon Aug 8 16:57:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 16:57:05.063506 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-441e6606-df32-4f07-8d92-a336971f2bd0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:05.064009 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-441e6606-df32-4f07-8d92-a336971f2bd0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:05.064456 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-441e6606-df32-4f07-8d92-a336971f2bd0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:05.065415 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-441e6606-df32-4f07-8d92-a336971f2bd0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:05.066358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-441e6606-df32-4f07-8d92-a336971f2bd0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:05.067020 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-441e6606-df32-4f07-8d92-a336971f2bd0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:05.251283 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-441e6606-df32-4f07-8d92-a336971f2bd0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:05.263533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-441e6606-df32-4f07-8d92-a336971f2bd0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1678 microversion: 2.1 time: 0.223007 Aug 08 16:57:05.264093 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 305/624] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:05 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:06.049996 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fcc47c73-7b04-4a86-b037-c639655795d4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:06.053144 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fcc47c73-7b04-4a86-b037-c639655795d4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:06.068207 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fcc47c73-7b04-4a86-b037-c639655795d4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:06.069697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fcc47c73-7b04-4a86-b037-c639655795d4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:06.071413 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fcc47c73-7b04-4a86-b037-c639655795d4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:06.073683 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fcc47c73-7b04-4a86-b037-c639655795d4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:06.074989 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fcc47c73-7b04-4a86-b037-c639655795d4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:06.076159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fcc47c73-7b04-4a86-b037-c639655795d4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:06.289042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f1d41974-7a9a-4640-9ca9-f7d15f17f7ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:06.291008 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f1d41974-7a9a-4640-9ca9-f7d15f17f7ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:06.298373 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f1d41974-7a9a-4640-9ca9-f7d15f17f7ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:06.299278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f1d41974-7a9a-4640-9ca9-f7d15f17f7ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:06.299966 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f1d41974-7a9a-4640-9ca9-f7d15f17f7ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:06.301064 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f1d41974-7a9a-4640-9ca9-f7d15f17f7ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:06.301783 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f1d41974-7a9a-4640-9ca9-f7d15f17f7ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:06.302430 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f1d41974-7a9a-4640-9ca9-f7d15f17f7ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:06.388157 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fcc47c73-7b04-4a86-b037-c639655795d4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:06.410321 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fcc47c73-7b04-4a86-b037-c639655795d4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:06.416332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fcc47c73-7b04-4a86-b037-c639655795d4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:06.421500 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fcc47c73-7b04-4a86-b037-c639655795d4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.387601 Aug 08 16:57:06.423772 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 320/625] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:06 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:57:06.524233 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f1d41974-7a9a-4640-9ca9-f7d15f17f7ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:06.533798 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f1d41974-7a9a-4640-9ca9-f7d15f17f7ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1678 microversion: 2.1 time: 0.249237 Aug 08 16:57:06.534741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 306/626] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:06 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1678 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:07.452082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-cddcd78a-d183-40ec-8aeb-5899d07a1fb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:07.460209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-cddcd78a-d183-40ec-8aeb-5899d07a1fb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:07.467181 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cddcd78a-d183-40ec-8aeb-5899d07a1fb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:07.467757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cddcd78a-d183-40ec-8aeb-5899d07a1fb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:07.468189 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cddcd78a-d183-40ec-8aeb-5899d07a1fb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:07.468998 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cddcd78a-d183-40ec-8aeb-5899d07a1fb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:07.469534 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cddcd78a-d183-40ec-8aeb-5899d07a1fb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:07.469945 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-cddcd78a-d183-40ec-8aeb-5899d07a1fb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:07.572402 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-df980e51-6b4d-4c65-accf-966df50ba539 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:07.573485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-df980e51-6b4d-4c65-accf-966df50ba539 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:07.586203 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:07.599886 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-df980e51-6b4d-4c65-accf-966df50ba539 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:07.601282 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-df980e51-6b4d-4c65-accf-966df50ba539 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:07.603229 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-df980e51-6b4d-4c65-accf-966df50ba539 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:07.604864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-df980e51-6b4d-4c65-accf-966df50ba539 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:07.605910 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-df980e51-6b4d-4c65-accf-966df50ba539 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:07.606492 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-df980e51-6b4d-4c65-accf-966df50ba539 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:07.877241 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-df980e51-6b4d-4c65-accf-966df50ba539 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:07.887412 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-df980e51-6b4d-4c65-accf-966df50ba539 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1678 microversion: 2.1 time: 0.322328 Aug 08 16:57:07.888451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 307/627] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:07 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1678 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:07.938326 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-cddcd78a-d183-40ec-8aeb-5899d07a1fb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:07.955237 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-cddcd78a-d183-40ec-8aeb-5899d07a1fb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:07.958839 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-cddcd78a-d183-40ec-8aeb-5899d07a1fb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:07.961257 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-cddcd78a-d183-40ec-8aeb-5899d07a1fb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.514494 Aug 08 16:57:07.974648 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 321/628] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:07 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:08.923159 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-be3f942e-55af-407b-ba20-0105389697f1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:08.935404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-be3f942e-55af-407b-ba20-0105389697f1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:08.964496 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-be3f942e-55af-407b-ba20-0105389697f1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:08.967443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-be3f942e-55af-407b-ba20-0105389697f1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:08.970455 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-be3f942e-55af-407b-ba20-0105389697f1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:08.972176 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-be3f942e-55af-407b-ba20-0105389697f1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:08.976356 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-be3f942e-55af-407b-ba20-0105389697f1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:08.981914 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-be3f942e-55af-407b-ba20-0105389697f1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:09.016170 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-465f9816-104d-4dd4-a8cd-7e26cfd96c6f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:09.019813 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-465f9816-104d-4dd4-a8cd-7e26cfd96c6f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:09.041881 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-465f9816-104d-4dd4-a8cd-7e26cfd96c6f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:09.050424 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-465f9816-104d-4dd4-a8cd-7e26cfd96c6f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:09.051728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-465f9816-104d-4dd4-a8cd-7e26cfd96c6f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:09.053329 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-465f9816-104d-4dd4-a8cd-7e26cfd96c6f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:09.054523 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-465f9816-104d-4dd4-a8cd-7e26cfd96c6f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:09.055583 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-465f9816-104d-4dd4-a8cd-7e26cfd96c6f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:09.145004 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-be3f942e-55af-407b-ba20-0105389697f1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:09.156774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-be3f942e-55af-407b-ba20-0105389697f1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1611 microversion: 2.1 time: 0.245281 Aug 08 16:57:09.170213 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 308/629] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:08 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1611 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:09.420183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-465f9816-104d-4dd4-a8cd-7e26cfd96c6f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:09.442274 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-465f9816-104d-4dd4-a8cd-7e26cfd96c6f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:09.445865 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-465f9816-104d-4dd4-a8cd-7e26cfd96c6f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:09.448243 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-465f9816-104d-4dd4-a8cd-7e26cfd96c6f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.450339 Aug 08 16:57:09.464224 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 322/630] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:08 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:57:09.637986 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-9793dce6-5a48-42c2-bbfb-30b833de3d85 req-6449cb81-6667-48b1-8b58-94bf737aa384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cfbc416-d601-45f7-82e8-a6d09c30f448", "name": "network-vif-deleted", "tag": "10a68390-2c05-4f51-b687-dc45d457b41d"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:09.642964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-9793dce6-5a48-42c2-bbfb-30b833de3d85 req-6449cb81-6667-48b1-8b58-94bf737aa384 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:09.643672 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-9793dce6-5a48-42c2-bbfb-30b833de3d85 req-6449cb81-6667-48b1-8b58-94bf737aa384 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:09.644182 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-9793dce6-5a48-42c2-bbfb-30b833de3d85 req-6449cb81-6667-48b1-8b58-94bf737aa384 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:09.661964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-9793dce6-5a48-42c2-bbfb-30b833de3d85 req-6449cb81-6667-48b1-8b58-94bf737aa384 service nova] Creating event network-vif-deleted:10a68390-2c05-4f51-b687-dc45d457b41d for instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 on hv-cinder-85220 Aug 08 16:57:09.668356 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-9793dce6-5a48-42c2-bbfb-30b833de3d85 req-6449cb81-6667-48b1-8b58-94bf737aa384 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045307 Aug 08 16:57:09.669150 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 309/631] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:10.203464 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ccac0832-2fb0-497f-a8ed-b6f85d8125aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:10.204220 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ccac0832-2fb0-497f-a8ed-b6f85d8125aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:10.211819 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ccac0832-2fb0-497f-a8ed-b6f85d8125aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:10.213196 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ccac0832-2fb0-497f-a8ed-b6f85d8125aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:10.213947 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ccac0832-2fb0-497f-a8ed-b6f85d8125aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:10.215238 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ccac0832-2fb0-497f-a8ed-b6f85d8125aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:10.215715 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ccac0832-2fb0-497f-a8ed-b6f85d8125aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:10.216141 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ccac0832-2fb0-497f-a8ed-b6f85d8125aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:10.293788 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ccac0832-2fb0-497f-a8ed-b6f85d8125aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:10.302392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ccac0832-2fb0-497f-a8ed-b6f85d8125aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1611 microversion: 2.1 time: 0.103516 Aug 08 16:57:10.318535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 323/632] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:10 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1611 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:10.481688 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-53a93eb8-0feb-4e58-93bc-65ecb57aa72f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:10.482965 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-53a93eb8-0feb-4e58-93bc-65ecb57aa72f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:10.511764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-53a93eb8-0feb-4e58-93bc-65ecb57aa72f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:10.514278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-53a93eb8-0feb-4e58-93bc-65ecb57aa72f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:10.516571 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-53a93eb8-0feb-4e58-93bc-65ecb57aa72f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:10.519901 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-53a93eb8-0feb-4e58-93bc-65ecb57aa72f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:10.527015 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-53a93eb8-0feb-4e58-93bc-65ecb57aa72f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:10.528071 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-53a93eb8-0feb-4e58-93bc-65ecb57aa72f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:10.967374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-53a93eb8-0feb-4e58-93bc-65ecb57aa72f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:10.978432 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-53a93eb8-0feb-4e58-93bc-65ecb57aa72f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:10.982313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-53a93eb8-0feb-4e58-93bc-65ecb57aa72f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:10.983370 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-53a93eb8-0feb-4e58-93bc-65ecb57aa72f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.510587 Aug 08 16:57:10.984176 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 310/633] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:10 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:11.342007 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:11.346004 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:11.361104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:11.362164 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:11.363259 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:11.364721 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:11.365919 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:11.367065 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:11.470627 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:11.471541 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:11.472372 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:11.473203 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lazy-loading 'fault' on Instance uuid 8cfbc416-d601-45f7-82e8-a6d09c30f448 {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:57:11.569040 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:11.580431 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a42b91d0-444c-4390-a8f2-ddce117a84d9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 200 len: 1330 microversion: 2.1 time: 0.245667 Aug 08 16:57:11.581648 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 324/634] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:11 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 1330 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:12.032957 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e4817bd6-9f04-43fe-b258-1fd6d09bd164 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:12.034836 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e4817bd6-9f04-43fe-b258-1fd6d09bd164 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:12.049869 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e4817bd6-9f04-43fe-b258-1fd6d09bd164 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:12.051329 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e4817bd6-9f04-43fe-b258-1fd6d09bd164 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:12.056893 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e4817bd6-9f04-43fe-b258-1fd6d09bd164 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:12.069932 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e4817bd6-9f04-43fe-b258-1fd6d09bd164 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:12.070601 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e4817bd6-9f04-43fe-b258-1fd6d09bd164 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:12.074644 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e4817bd6-9f04-43fe-b258-1fd6d09bd164 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:12.411971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e4817bd6-9f04-43fe-b258-1fd6d09bd164 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:12.418401 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e4817bd6-9f04-43fe-b258-1fd6d09bd164 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:12.420150 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e4817bd6-9f04-43fe-b258-1fd6d09bd164 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:12.421449 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e4817bd6-9f04-43fe-b258-1fd6d09bd164 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.392598 Aug 08 16:57:12.422051 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 311/635] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:12 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:12.606169 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-80151adc-6930-44b0-9072-51b4a9fd9e2c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:12.607108 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-80151adc-6930-44b0-9072-51b4a9fd9e2c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:12.614592 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80151adc-6930-44b0-9072-51b4a9fd9e2c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:12.615107 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80151adc-6930-44b0-9072-51b4a9fd9e2c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:12.615562 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80151adc-6930-44b0-9072-51b4a9fd9e2c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:12.616289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80151adc-6930-44b0-9072-51b4a9fd9e2c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:12.616760 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80151adc-6930-44b0-9072-51b4a9fd9e2c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:12.617195 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80151adc-6930-44b0-9072-51b4a9fd9e2c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:12.649096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-80151adc-6930-44b0-9072-51b4a9fd9e2c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-80151adc-6930-44b0-9072-51b4a9fd9e2c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 HTTP/1.1 Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 16:57:12.656538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 16:57:12.658258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:57:12.658258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:57:12.658258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 16:57:12.658258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:57:12.658258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 16:57:12.658258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 16:57:12.658258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 16:57:12.658258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 16:57:12.658258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 16:57:12.658258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 16:57:12.658258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 16:57:12.658258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': '8cfbc416-d601-45f7-82e8-a6d09c30f448'} Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:57:12.659223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 16:57:12.660739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:57:12.662214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-80151adc-6930-44b0-9072-51b4a9fd9e2c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 404 to user: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:57:12.662214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-80151adc-6930-44b0-9072-51b4a9fd9e2c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 404 len: 111 microversion: 2.1 time: 0.050734 Aug 08 16:57:12.662214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 325/636] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:12 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:57:12.683588 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-221d7768-d435-4742-81e8-5c48b9db51f2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '.version_select at 0x7f5015ff7e50>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:12.779750 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-221d7768-d435-4742-81e8-5c48b9db51f2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-638390926" status: 202 len: 0 microversion: 2.1 time: 0.105405 Aug 08 16:57:12.784618 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 312/637] 10.222.0.13 () {58 vars in 1218 bytes} [Mon Aug 8 16:57:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-638390926 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:57:13.067313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3f742f60-0137-4634-8ded-982702a22202 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:13.080863 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3f742f60-0137-4634-8ded-982702a22202 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:13.081517 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3f742f60-0137-4634-8ded-982702a22202 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:13.082062 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3f742f60-0137-4634-8ded-982702a22202 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:13.165507 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3f742f60-0137-4634-8ded-982702a22202 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Going to try to stop instance {{(pid=130236) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 16:57:13.404394 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3f742f60-0137-4634-8ded-982702a22202 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "POST /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/action" status: 202 len: 0 microversion: 2.1 time: 0.337592 Aug 08 16:57:13.406261 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 326/638] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 16:57:13 2022] POST /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 16:57:13.428512 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-da90336d-1e77-4b9f-8dd8-54dcbcf4f003 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:13.431337 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-da90336d-1e77-4b9f-8dd8-54dcbcf4f003 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:13.444720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-da90336d-1e77-4b9f-8dd8-54dcbcf4f003 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:13.446189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-da90336d-1e77-4b9f-8dd8-54dcbcf4f003 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:13.447421 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-da90336d-1e77-4b9f-8dd8-54dcbcf4f003 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:13.449117 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-da90336d-1e77-4b9f-8dd8-54dcbcf4f003 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:13.450704 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-da90336d-1e77-4b9f-8dd8-54dcbcf4f003 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:13.451756 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-da90336d-1e77-4b9f-8dd8-54dcbcf4f003 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:13.458539 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4c709f6f-45d7-4bf4-a630-2d37656c2a8b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:13.478026 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4c709f6f-45d7-4bf4-a630-2d37656c2a8b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:13.499378 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4c709f6f-45d7-4bf4-a630-2d37656c2a8b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:13.500249 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4c709f6f-45d7-4bf4-a630-2d37656c2a8b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:13.500987 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4c709f6f-45d7-4bf4-a630-2d37656c2a8b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:13.502096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4c709f6f-45d7-4bf4-a630-2d37656c2a8b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:13.519009 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4c709f6f-45d7-4bf4-a630-2d37656c2a8b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:13.520406 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4c709f6f-45d7-4bf4-a630-2d37656c2a8b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:13.770627 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-da90336d-1e77-4b9f-8dd8-54dcbcf4f003 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:13.784353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-da90336d-1e77-4b9f-8dd8-54dcbcf4f003 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.371612 Aug 08 16:57:13.800386 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 313/639] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:13 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:13.814686 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4c709f6f-45d7-4bf4-a630-2d37656c2a8b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:13.831039 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4c709f6f-45d7-4bf4-a630-2d37656c2a8b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:13.834932 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4c709f6f-45d7-4bf4-a630-2d37656c2a8b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:13.838235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4c709f6f-45d7-4bf4-a630-2d37656c2a8b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.393817 Aug 08 16:57:13.839962 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 327/640] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:13 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:14.467623 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8c91b5b6-0732-4be6-97d5-5ff68d4f03aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:14.469191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8c91b5b6-0732-4be6-97d5-5ff68d4f03aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:14.480414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8c91b5b6-0732-4be6-97d5-5ff68d4f03aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:14.481069 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8c91b5b6-0732-4be6-97d5-5ff68d4f03aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:14.481612 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8c91b5b6-0732-4be6-97d5-5ff68d4f03aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:14.482554 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8c91b5b6-0732-4be6-97d5-5ff68d4f03aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:14.483386 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8c91b5b6-0732-4be6-97d5-5ff68d4f03aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:14.484129 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8c91b5b6-0732-4be6-97d5-5ff68d4f03aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:14.719332 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-8c91b5b6-0732-4be6-97d5-5ff68d4f03aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lazy-loading 'services' on Instance uuid e0affcec-8e4c-461a-ac29-5ac8d4fd92bd {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:57:14.830892 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-db80b596-4b97-424a-bea0-ea9f8f6d4324 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:14.837745 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-db80b596-4b97-424a-bea0-ea9f8f6d4324 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:14.854095 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-db80b596-4b97-424a-bea0-ea9f8f6d4324 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:14.855339 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-db80b596-4b97-424a-bea0-ea9f8f6d4324 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:14.856040 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-db80b596-4b97-424a-bea0-ea9f8f6d4324 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:14.858695 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-db80b596-4b97-424a-bea0-ea9f8f6d4324 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:14.858695 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-db80b596-4b97-424a-bea0-ea9f8f6d4324 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:14.860267 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-db80b596-4b97-424a-bea0-ea9f8f6d4324 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:14.903637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=89,nova_cell1:INSERT=5 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:15.084994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8c91b5b6-0732-4be6-97d5-5ff68d4f03aa tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments/153a3016-da47-456e-9992-fa3763b2943f" status: 202 len: 0 microversion: 2.1 time: 0.625292 Aug 08 16:57:15.088057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 314/641] 10.222.0.13 () {58 vars in 1416 bytes} [Mon Aug 8 16:57:14 2022] DELETE /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments/153a3016-da47-456e-9992-fa3763b2943f => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:57:15.096918 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9567d32c-87a8-42a7-aa7a-15c6a8b13f45 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:15.098182 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9567d32c-87a8-42a7-aa7a-15c6a8b13f45 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:15.108656 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9567d32c-87a8-42a7-aa7a-15c6a8b13f45 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:15.109165 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9567d32c-87a8-42a7-aa7a-15c6a8b13f45 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:15.109681 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9567d32c-87a8-42a7-aa7a-15c6a8b13f45 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:15.110419 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9567d32c-87a8-42a7-aa7a-15c6a8b13f45 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:15.110921 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9567d32c-87a8-42a7-aa7a-15c6a8b13f45 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:15.111356 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9567d32c-87a8-42a7-aa7a-15c6a8b13f45 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:15.132887 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-db80b596-4b97-424a-bea0-ea9f8f6d4324 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:15.158390 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-db80b596-4b97-424a-bea0-ea9f8f6d4324 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.337070 Aug 08 16:57:15.159552 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 328/642] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:14 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:15.173376 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-bb944ee8-2c5f-4a6a-a7c1-db8d8713051d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:15.181036 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-bb944ee8-2c5f-4a6a-a7c1-db8d8713051d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:15.195918 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bb944ee8-2c5f-4a6a-a7c1-db8d8713051d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:15.197402 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bb944ee8-2c5f-4a6a-a7c1-db8d8713051d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:15.198309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bb944ee8-2c5f-4a6a-a7c1-db8d8713051d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:15.200100 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bb944ee8-2c5f-4a6a-a7c1-db8d8713051d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:15.201134 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bb944ee8-2c5f-4a6a-a7c1-db8d8713051d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:15.202042 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bb944ee8-2c5f-4a6a-a7c1-db8d8713051d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:15.266809 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-bb944ee8-2c5f-4a6a-a7c1-db8d8713051d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099766 Aug 08 16:57:15.267884 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 329/643] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:15 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:15.373159 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9567d32c-87a8-42a7-aa7a-15c6a8b13f45 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:15.382007 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9567d32c-87a8-42a7-aa7a-15c6a8b13f45 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:15.384629 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9567d32c-87a8-42a7-aa7a-15c6a8b13f45 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:15.386061 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9567d32c-87a8-42a7-aa7a-15c6a8b13f45 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.299104 Aug 08 16:57:15.386761 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 315/644] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:15 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:16.209935 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-dbfe32cb-8f7c-4617-94bd-08a1d5f19d67 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:16.210640 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-dbfe32cb-8f7c-4617-94bd-08a1d5f19d67 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:16.221358 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dbfe32cb-8f7c-4617-94bd-08a1d5f19d67 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:16.222547 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dbfe32cb-8f7c-4617-94bd-08a1d5f19d67 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:16.223342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dbfe32cb-8f7c-4617-94bd-08a1d5f19d67 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:16.224648 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dbfe32cb-8f7c-4617-94bd-08a1d5f19d67 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:16.225471 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dbfe32cb-8f7c-4617-94bd-08a1d5f19d67 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:16.226166 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dbfe32cb-8f7c-4617-94bd-08a1d5f19d67 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:16.285413 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5598be6f-81b4-46cd-827f-a6f0adea0220 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:16.288897 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5598be6f-81b4-46cd-827f-a6f0adea0220 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:16.299741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5598be6f-81b4-46cd-827f-a6f0adea0220 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:16.300772 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5598be6f-81b4-46cd-827f-a6f0adea0220 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:16.301374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5598be6f-81b4-46cd-827f-a6f0adea0220 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:16.302558 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5598be6f-81b4-46cd-827f-a6f0adea0220 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:16.303339 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5598be6f-81b4-46cd-827f-a6f0adea0220 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:16.304126 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5598be6f-81b4-46cd-827f-a6f0adea0220 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:16.344561 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5598be6f-81b4-46cd-827f-a6f0adea0220 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064423 Aug 08 16:57:16.345176 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 316/645] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:16 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:16.421598 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-65d18fd1-fb2f-4d6d-9c6f-ba4a18843a99 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:16.421598 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-65d18fd1-fb2f-4d6d-9c6f-ba4a18843a99 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:16.436214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-65d18fd1-fb2f-4d6d-9c6f-ba4a18843a99 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:16.438275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-65d18fd1-fb2f-4d6d-9c6f-ba4a18843a99 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:16.438275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-65d18fd1-fb2f-4d6d-9c6f-ba4a18843a99 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:16.440173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-65d18fd1-fb2f-4d6d-9c6f-ba4a18843a99 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:16.441776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-65d18fd1-fb2f-4d6d-9c6f-ba4a18843a99 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:16.443309 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-65d18fd1-fb2f-4d6d-9c6f-ba4a18843a99 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:16.471744 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-dbfe32cb-8f7c-4617-94bd-08a1d5f19d67 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:16.507991 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-dbfe32cb-8f7c-4617-94bd-08a1d5f19d67 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.295480 Aug 08 16:57:16.511543 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 330/646] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:16 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:16.780929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-65d18fd1-fb2f-4d6d-9c6f-ba4a18843a99 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:16.780929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-65d18fd1-fb2f-4d6d-9c6f-ba4a18843a99 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:16.785025 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-65d18fd1-fb2f-4d6d-9c6f-ba4a18843a99 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:16.786303 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-65d18fd1-fb2f-4d6d-9c6f-ba4a18843a99 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.377593 Aug 08 16:57:16.787515 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 317/647] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:16 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:57:17.360986 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-74b0e897-b101-4c5b-ab14-5de1ccfb4f90 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:17.363448 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-74b0e897-b101-4c5b-ab14-5de1ccfb4f90 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:17.371317 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-74b0e897-b101-4c5b-ab14-5de1ccfb4f90 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:17.371879 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-74b0e897-b101-4c5b-ab14-5de1ccfb4f90 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:17.372313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-74b0e897-b101-4c5b-ab14-5de1ccfb4f90 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:17.373018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-74b0e897-b101-4c5b-ab14-5de1ccfb4f90 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:17.373534 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-74b0e897-b101-4c5b-ab14-5de1ccfb4f90 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:17.373951 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-74b0e897-b101-4c5b-ab14-5de1ccfb4f90 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:17.414322 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-74b0e897-b101-4c5b-ab14-5de1ccfb4f90 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057648 Aug 08 16:57:17.415821 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 331/648] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:17 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:17.547640 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-63b15021-f9a8-433e-ae64-fad871c92b39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:17.548290 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-63b15021-f9a8-433e-ae64-fad871c92b39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:17.556100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-63b15021-f9a8-433e-ae64-fad871c92b39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:17.557681 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-63b15021-f9a8-433e-ae64-fad871c92b39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:17.557681 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-63b15021-f9a8-433e-ae64-fad871c92b39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:17.558001 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-63b15021-f9a8-433e-ae64-fad871c92b39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:17.558450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-63b15021-f9a8-433e-ae64-fad871c92b39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:17.558905 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-63b15021-f9a8-433e-ae64-fad871c92b39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:17.747799 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-63b15021-f9a8-433e-ae64-fad871c92b39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:17.756080 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-63b15021-f9a8-433e-ae64-fad871c92b39 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.212501 Aug 08 16:57:17.756681 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 318/649] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:17 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:17.820121 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-af915d8d-c819-41c5-9243-f77d63e15f38 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:17.821666 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-af915d8d-c819-41c5-9243-f77d63e15f38 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:17.833699 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af915d8d-c819-41c5-9243-f77d63e15f38 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:17.836094 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af915d8d-c819-41c5-9243-f77d63e15f38 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:17.836094 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af915d8d-c819-41c5-9243-f77d63e15f38 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:17.837757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af915d8d-c819-41c5-9243-f77d63e15f38 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:17.838596 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af915d8d-c819-41c5-9243-f77d63e15f38 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:17.839474 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af915d8d-c819-41c5-9243-f77d63e15f38 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:18.029621 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-af915d8d-c819-41c5-9243-f77d63e15f38 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:18.038898 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-af915d8d-c819-41c5-9243-f77d63e15f38 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:18.040665 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-af915d8d-c819-41c5-9243-f77d63e15f38 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:18.041908 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-af915d8d-c819-41c5-9243-f77d63e15f38 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.234530 Aug 08 16:57:18.042481 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 332/650] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:17 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:18.429969 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0e5c1a99-647b-4d51-9f44-5289a9b1506b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:18.432771 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0e5c1a99-647b-4d51-9f44-5289a9b1506b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:18.439004 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e5c1a99-647b-4d51-9f44-5289a9b1506b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:18.439483 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e5c1a99-647b-4d51-9f44-5289a9b1506b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:18.439918 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e5c1a99-647b-4d51-9f44-5289a9b1506b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:18.440627 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e5c1a99-647b-4d51-9f44-5289a9b1506b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:18.441075 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e5c1a99-647b-4d51-9f44-5289a9b1506b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:18.441491 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e5c1a99-647b-4d51-9f44-5289a9b1506b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:18.475324 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0e5c1a99-647b-4d51-9f44-5289a9b1506b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049182 Aug 08 16:57:18.475835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 319/651] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:18 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:18.779858 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fb06b7ef-143c-4e9a-a30d-2cc3cb947ed2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:18.780437 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fb06b7ef-143c-4e9a-a30d-2cc3cb947ed2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:18.787616 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb06b7ef-143c-4e9a-a30d-2cc3cb947ed2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:18.788115 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb06b7ef-143c-4e9a-a30d-2cc3cb947ed2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:18.788861 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb06b7ef-143c-4e9a-a30d-2cc3cb947ed2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:18.789685 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb06b7ef-143c-4e9a-a30d-2cc3cb947ed2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:18.791038 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb06b7ef-143c-4e9a-a30d-2cc3cb947ed2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:18.791218 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fb06b7ef-143c-4e9a-a30d-2cc3cb947ed2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:18.957756 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fb06b7ef-143c-4e9a-a30d-2cc3cb947ed2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:18.967095 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fb06b7ef-143c-4e9a-a30d-2cc3cb947ed2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.191175 Aug 08 16:57:18.967917 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 333/652] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:18 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:19.066045 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5a2c9c17-f70a-4ac7-ba31-5994b86d0d88 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:19.066755 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5a2c9c17-f70a-4ac7-ba31-5994b86d0d88 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:19.074711 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5a2c9c17-f70a-4ac7-ba31-5994b86d0d88 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:19.075207 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5a2c9c17-f70a-4ac7-ba31-5994b86d0d88 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:19.075648 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5a2c9c17-f70a-4ac7-ba31-5994b86d0d88 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:19.076369 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5a2c9c17-f70a-4ac7-ba31-5994b86d0d88 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:19.076824 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5a2c9c17-f70a-4ac7-ba31-5994b86d0d88 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:19.077247 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5a2c9c17-f70a-4ac7-ba31-5994b86d0d88 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:19.231011 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5a2c9c17-f70a-4ac7-ba31-5994b86d0d88 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:19.236858 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:19.240327 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5a2c9c17-f70a-4ac7-ba31-5994b86d0d88 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:19.241885 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5a2c9c17-f70a-4ac7-ba31-5994b86d0d88 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:19.243119 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5a2c9c17-f70a-4ac7-ba31-5994b86d0d88 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.181405 Aug 08 16:57:19.243682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 320/653] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:19 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:19.493206 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-adc0ea75-e827-409f-b745-82f29b78a3a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:19.498026 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-adc0ea75-e827-409f-b745-82f29b78a3a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:19.510735 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-adc0ea75-e827-409f-b745-82f29b78a3a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:19.511618 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-adc0ea75-e827-409f-b745-82f29b78a3a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:19.512403 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-adc0ea75-e827-409f-b745-82f29b78a3a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:19.513660 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-adc0ea75-e827-409f-b745-82f29b78a3a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:19.514468 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-adc0ea75-e827-409f-b745-82f29b78a3a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:19.515240 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-adc0ea75-e827-409f-b745-82f29b78a3a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:19.577749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-adc0ea75-e827-409f-b745-82f29b78a3a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092271 Aug 08 16:57:19.578739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 334/654] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:19 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:19.989861 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e4e10740-3873-4638-ade6-02623893b64d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:19.990469 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e4e10740-3873-4638-ade6-02623893b64d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:19.998381 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e4e10740-3873-4638-ade6-02623893b64d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:19.998943 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e4e10740-3873-4638-ade6-02623893b64d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:19.999380 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e4e10740-3873-4638-ade6-02623893b64d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:20.000095 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e4e10740-3873-4638-ade6-02623893b64d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:20.000548 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e4e10740-3873-4638-ade6-02623893b64d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:20.000968 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e4e10740-3873-4638-ade6-02623893b64d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:20.146496 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e4e10740-3873-4638-ade6-02623893b64d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:20.155634 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e4e10740-3873-4638-ade6-02623893b64d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.169577 Aug 08 16:57:20.156316 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 321/655] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:19 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:20.266333 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-178787f1-f19a-4349-b63f-26c74915b581 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:20.267354 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-178787f1-f19a-4349-b63f-26c74915b581 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:20.274497 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-178787f1-f19a-4349-b63f-26c74915b581 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:20.275022 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-178787f1-f19a-4349-b63f-26c74915b581 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:20.275455 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-178787f1-f19a-4349-b63f-26c74915b581 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:20.276156 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-178787f1-f19a-4349-b63f-26c74915b581 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:20.276609 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-178787f1-f19a-4349-b63f-26c74915b581 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:20.277026 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-178787f1-f19a-4349-b63f-26c74915b581 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:20.440054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-178787f1-f19a-4349-b63f-26c74915b581 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:20.450603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-178787f1-f19a-4349-b63f-26c74915b581 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:20.452178 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-178787f1-f19a-4349-b63f-26c74915b581 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:20.453389 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-178787f1-f19a-4349-b63f-26c74915b581 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.191163 Aug 08 16:57:20.453963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 335/656] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:20 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:20.592107 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4b15b97d-684f-4981-a356-267fb0692430 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:20.594406 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4b15b97d-684f-4981-a356-267fb0692430 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:20.601251 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4b15b97d-684f-4981-a356-267fb0692430 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:20.601751 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4b15b97d-684f-4981-a356-267fb0692430 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:20.602400 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4b15b97d-684f-4981-a356-267fb0692430 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:20.603208 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4b15b97d-684f-4981-a356-267fb0692430 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:20.603678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4b15b97d-684f-4981-a356-267fb0692430 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:20.604112 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4b15b97d-684f-4981-a356-267fb0692430 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:20.639082 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4b15b97d-684f-4981-a356-267fb0692430 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051099 Aug 08 16:57:20.639803 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 322/657] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:20 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:21.180743 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4d20f58b-c376-48e5-8c92-f32782d8dae6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:21.181645 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4d20f58b-c376-48e5-8c92-f32782d8dae6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:21.188126 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4d20f58b-c376-48e5-8c92-f32782d8dae6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:21.188618 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4d20f58b-c376-48e5-8c92-f32782d8dae6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:21.189064 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4d20f58b-c376-48e5-8c92-f32782d8dae6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:21.189772 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4d20f58b-c376-48e5-8c92-f32782d8dae6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:21.190226 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4d20f58b-c376-48e5-8c92-f32782d8dae6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:21.190679 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4d20f58b-c376-48e5-8c92-f32782d8dae6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:21.349746 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4d20f58b-c376-48e5-8c92-f32782d8dae6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:21.358557 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4d20f58b-c376-48e5-8c92-f32782d8dae6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.182287 Aug 08 16:57:21.359332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 336/658] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:21 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:21.477754 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d3d50642-60b1-4df8-a992-e5afb32756ec tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:21.478699 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d3d50642-60b1-4df8-a992-e5afb32756ec tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:21.485736 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d3d50642-60b1-4df8-a992-e5afb32756ec tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:21.486234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d3d50642-60b1-4df8-a992-e5afb32756ec tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:21.486711 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d3d50642-60b1-4df8-a992-e5afb32756ec tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:21.487429 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d3d50642-60b1-4df8-a992-e5afb32756ec tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:21.487881 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d3d50642-60b1-4df8-a992-e5afb32756ec tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:21.488302 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d3d50642-60b1-4df8-a992-e5afb32756ec tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:21.653128 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a6c61f7e-7ec7-428c-8619-d29c6eb283ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:21.655515 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a6c61f7e-7ec7-428c-8619-d29c6eb283ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:21.660616 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d3d50642-60b1-4df8-a992-e5afb32756ec tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:21.662178 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6c61f7e-7ec7-428c-8619-d29c6eb283ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:21.662726 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6c61f7e-7ec7-428c-8619-d29c6eb283ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:21.667092 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6c61f7e-7ec7-428c-8619-d29c6eb283ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:21.667092 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6c61f7e-7ec7-428c-8619-d29c6eb283ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:21.667092 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6c61f7e-7ec7-428c-8619-d29c6eb283ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:21.667092 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6c61f7e-7ec7-428c-8619-d29c6eb283ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:21.670636 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d3d50642-60b1-4df8-a992-e5afb32756ec tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:21.672196 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d3d50642-60b1-4df8-a992-e5afb32756ec tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:21.673412 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d3d50642-60b1-4df8-a992-e5afb32756ec tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1739 microversion: 2.20 time: 0.199946 Aug 08 16:57:21.673989 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 323/659] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:21 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:21.704406 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a6c61f7e-7ec7-428c-8619-d29c6eb283ef tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055807 Aug 08 16:57:21.704903 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 337/660] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:21 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:57:22.382506 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-42764152-f7e2-4d84-9f2e-8cb44b995c28 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:22.383872 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-42764152-f7e2-4d84-9f2e-8cb44b995c28 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:22.392131 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-42764152-f7e2-4d84-9f2e-8cb44b995c28 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:22.392699 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-42764152-f7e2-4d84-9f2e-8cb44b995c28 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:22.393241 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-42764152-f7e2-4d84-9f2e-8cb44b995c28 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:22.394230 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-42764152-f7e2-4d84-9f2e-8cb44b995c28 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:22.394843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-42764152-f7e2-4d84-9f2e-8cb44b995c28 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:22.395432 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-42764152-f7e2-4d84-9f2e-8cb44b995c28 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:22.625996 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-42764152-f7e2-4d84-9f2e-8cb44b995c28 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:22.642387 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-42764152-f7e2-4d84-9f2e-8cb44b995c28 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.263875 Aug 08 16:57:22.646327 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 324/661] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:22 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:22.707755 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-98207ff7-ae5b-4858-b607-41ca534762c0 req-7a7b77a4-588f-4563-90e7-6709e47f4ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70c7402-29f3-48b0-b5fc-dd586f6e4266", "name": "network-vif-unplugged", "status": "completed", "tag": "ee6f4872-65bc-467b-9551-24824a3b32ad"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:22.708092 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d76d5fa9-6a65-4b88-85d9-920c69d62ee7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:22.709243 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d76d5fa9-6a65-4b88-85d9-920c69d62ee7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:22.721185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d76d5fa9-6a65-4b88-85d9-920c69d62ee7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:22.721879 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d76d5fa9-6a65-4b88-85d9-920c69d62ee7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:22.722613 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d76d5fa9-6a65-4b88-85d9-920c69d62ee7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:22.723788 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d76d5fa9-6a65-4b88-85d9-920c69d62ee7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:22.724574 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d76d5fa9-6a65-4b88-85d9-920c69d62ee7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:22.725303 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d76d5fa9-6a65-4b88-85d9-920c69d62ee7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:22.728004 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-98207ff7-ae5b-4858-b607-41ca534762c0 req-7a7b77a4-588f-4563-90e7-6709e47f4ae7 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:22.728771 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-98207ff7-ae5b-4858-b607-41ca534762c0 req-7a7b77a4-588f-4563-90e7-6709e47f4ae7 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:22.729647 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-98207ff7-ae5b-4858-b607-41ca534762c0 req-7a7b77a4-588f-4563-90e7-6709e47f4ae7 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:22.753571 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-98207ff7-ae5b-4858-b607-41ca534762c0 req-7a7b77a4-588f-4563-90e7-6709e47f4ae7 service nova] Creating event network-vif-unplugged:ee6f4872-65bc-467b-9551-24824a3b32ad for instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 on hv-cinder-85220 Aug 08 16:57:22.756839 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-98207ff7-ae5b-4858-b607-41ca534762c0 req-7a7b77a4-588f-4563-90e7-6709e47f4ae7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055219 Aug 08 16:57:22.757757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 325/662] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:22.767420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1fb740bc-05bc-44ce-ba8b-cdaee1c016bf tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:22.771170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1fb740bc-05bc-44ce-ba8b-cdaee1c016bf tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:22.782207 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1fb740bc-05bc-44ce-ba8b-cdaee1c016bf tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:22.782885 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1fb740bc-05bc-44ce-ba8b-cdaee1c016bf tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:22.783443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1fb740bc-05bc-44ce-ba8b-cdaee1c016bf tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:22.784356 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1fb740bc-05bc-44ce-ba8b-cdaee1c016bf tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:22.784901 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1fb740bc-05bc-44ce-ba8b-cdaee1c016bf tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:22.785364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1fb740bc-05bc-44ce-ba8b-cdaee1c016bf tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:22.834423 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1fb740bc-05bc-44ce-ba8b-cdaee1c016bf tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073517 Aug 08 16:57:22.834625 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 326/663] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:22 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:22.933653 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d76d5fa9-6a65-4b88-85d9-920c69d62ee7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:22.943392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d76d5fa9-6a65-4b88-85d9-920c69d62ee7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:22.945127 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d76d5fa9-6a65-4b88-85d9-920c69d62ee7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:22.947673 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d76d5fa9-6a65-4b88-85d9-920c69d62ee7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1721 microversion: 2.20 time: 0.247308 Aug 08 16:57:22.948358 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 338/664] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:22 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:23.678259 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9d7162a7-9204-4c83-91fa-e0c5b2699af6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:23.679083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9d7162a7-9204-4c83-91fa-e0c5b2699af6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:23.687644 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9d7162a7-9204-4c83-91fa-e0c5b2699af6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:23.688128 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9d7162a7-9204-4c83-91fa-e0c5b2699af6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:23.688608 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9d7162a7-9204-4c83-91fa-e0c5b2699af6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:23.689326 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9d7162a7-9204-4c83-91fa-e0c5b2699af6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:23.689779 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9d7162a7-9204-4c83-91fa-e0c5b2699af6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:23.690199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9d7162a7-9204-4c83-91fa-e0c5b2699af6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:23.849226 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-64f385ef-054b-40d9-a126-d5f9474a372f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:23.853783 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-64f385ef-054b-40d9-a126-d5f9474a372f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:23.861489 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-64f385ef-054b-40d9-a126-d5f9474a372f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:23.862077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-64f385ef-054b-40d9-a126-d5f9474a372f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:23.862908 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-64f385ef-054b-40d9-a126-d5f9474a372f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:23.864133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-64f385ef-054b-40d9-a126-d5f9474a372f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:23.864794 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-64f385ef-054b-40d9-a126-d5f9474a372f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:23.865503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-64f385ef-054b-40d9-a126-d5f9474a372f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:23.868087 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9d7162a7-9204-4c83-91fa-e0c5b2699af6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:23.886231 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9d7162a7-9204-4c83-91fa-e0c5b2699af6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.211596 Aug 08 16:57:23.888228 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 327/665] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:23 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:23.904369 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-64f385ef-054b-40d9-a126-d5f9474a372f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059572 Aug 08 16:57:23.905227 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 339/666] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:23 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:57:23.975210 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-07b067bd-1d29-455e-9b53-b9630bf3f663 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:23.975985 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-07b067bd-1d29-455e-9b53-b9630bf3f663 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:23.984249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07b067bd-1d29-455e-9b53-b9630bf3f663 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:23.984797 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07b067bd-1d29-455e-9b53-b9630bf3f663 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:23.985278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07b067bd-1d29-455e-9b53-b9630bf3f663 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:23.986042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07b067bd-1d29-455e-9b53-b9630bf3f663 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:23.986543 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07b067bd-1d29-455e-9b53-b9630bf3f663 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:23.987058 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-07b067bd-1d29-455e-9b53-b9630bf3f663 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:24.140548 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-07b067bd-1d29-455e-9b53-b9630bf3f663 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:24.149420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-07b067bd-1d29-455e-9b53-b9630bf3f663 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:24.151351 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-07b067bd-1d29-455e-9b53-b9630bf3f663 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:24.152551 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-07b067bd-1d29-455e-9b53-b9630bf3f663 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1721 microversion: 2.20 time: 0.182184 Aug 08 16:57:24.153126 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 328/667] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:23 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:24.910177 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-98e57993-1e29-49d3-8650-c91c40948938 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:24.911092 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-98e57993-1e29-49d3-8650-c91c40948938 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:24.918476 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-98e57993-1e29-49d3-8650-c91c40948938 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:24.919351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-98e57993-1e29-49d3-8650-c91c40948938 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:24.919789 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-98e57993-1e29-49d3-8650-c91c40948938 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:24.920538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-98e57993-1e29-49d3-8650-c91c40948938 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:24.920991 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-98e57993-1e29-49d3-8650-c91c40948938 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:24.921431 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-98e57993-1e29-49d3-8650-c91c40948938 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:24.928118 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9ffb3097-0df9-4452-a18f-f4ecdeb9de9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:24.933101 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9ffb3097-0df9-4452-a18f-f4ecdeb9de9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:24.944592 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9ffb3097-0df9-4452-a18f-f4ecdeb9de9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:24.945513 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9ffb3097-0df9-4452-a18f-f4ecdeb9de9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:24.946528 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9ffb3097-0df9-4452-a18f-f4ecdeb9de9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:24.947817 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9ffb3097-0df9-4452-a18f-f4ecdeb9de9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:24.948656 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9ffb3097-0df9-4452-a18f-f4ecdeb9de9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:24.949400 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9ffb3097-0df9-4452-a18f-f4ecdeb9de9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:24.991382 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9ffb3097-0df9-4452-a18f-f4ecdeb9de9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076698 Aug 08 16:57:24.992045 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 329/668] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:24 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:57:25.108328 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-98e57993-1e29-49d3-8650-c91c40948938 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:25.116908 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-98e57993-1e29-49d3-8650-c91c40948938 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.210946 Aug 08 16:57:25.118111 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 340/669] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:24 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:25.177631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f9190b22-0da4-4043-aaef-3e79143b8ca0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:25.178251 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f9190b22-0da4-4043-aaef-3e79143b8ca0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:25.186196 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f9190b22-0da4-4043-aaef-3e79143b8ca0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:25.186787 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f9190b22-0da4-4043-aaef-3e79143b8ca0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:25.187301 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f9190b22-0da4-4043-aaef-3e79143b8ca0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:25.188079 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f9190b22-0da4-4043-aaef-3e79143b8ca0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:25.188649 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f9190b22-0da4-4043-aaef-3e79143b8ca0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:25.189151 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f9190b22-0da4-4043-aaef-3e79143b8ca0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:25.341527 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f9190b22-0da4-4043-aaef-3e79143b8ca0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:25.350065 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f9190b22-0da4-4043-aaef-3e79143b8ca0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:25.351606 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f9190b22-0da4-4043-aaef-3e79143b8ca0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:25.353790 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f9190b22-0da4-4043-aaef-3e79143b8ca0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1721 microversion: 2.20 time: 0.180167 Aug 08 16:57:25.354393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 330/670] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:25 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:57:25.563236 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4364bfca-be6d-4af5-ab69-7b688c788e7b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:25.563730 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4364bfca-be6d-4af5-ab69-7b688c788e7b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:25.570289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4364bfca-be6d-4af5-ab69-7b688c788e7b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:25.571486 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4364bfca-be6d-4af5-ab69-7b688c788e7b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:25.572230 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4364bfca-be6d-4af5-ab69-7b688c788e7b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:25.573012 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4364bfca-be6d-4af5-ab69-7b688c788e7b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:25.573537 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4364bfca-be6d-4af5-ab69-7b688c788e7b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:25.573900 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4364bfca-be6d-4af5-ab69-7b688c788e7b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:25.666970 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-4364bfca-be6d-4af5-ab69-7b688c788e7b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lazy-loading 'services' on Instance uuid 00980f58-f4e7-4ca4-9f21-d8d665401320 {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:57:25.919158 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4364bfca-be6d-4af5-ab69-7b688c788e7b tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "DELETE /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320/os-volume_attachments/29f2530f-5458-4bdb-9bf9-82d579222802" status: 202 len: 0 microversion: 2.1 time: 0.359245 Aug 08 16:57:25.924848 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 341/671] 10.222.0.13 () {58 vars in 1416 bytes} [Mon Aug 8 16:57:25 2022] DELETE /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320/os-volume_attachments/29f2530f-5458-4bdb-9bf9-82d579222802 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:57:26.005744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1a42791b-94cf-431e-a613-25d30a911227 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:26.008635 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1a42791b-94cf-431e-a613-25d30a911227 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:26.016704 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1a42791b-94cf-431e-a613-25d30a911227 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:26.017584 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1a42791b-94cf-431e-a613-25d30a911227 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:26.018349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1a42791b-94cf-431e-a613-25d30a911227 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:26.019601 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1a42791b-94cf-431e-a613-25d30a911227 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:26.020400 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1a42791b-94cf-431e-a613-25d30a911227 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:26.021151 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1a42791b-94cf-431e-a613-25d30a911227 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:26.079672 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1a42791b-94cf-431e-a613-25d30a911227 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077558 Aug 08 16:57:26.080407 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 331/672] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:26 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:26.153365 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-962b9d11-ac56-413a-b018-a30c65ea134f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:26.154116 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-962b9d11-ac56-413a-b018-a30c65ea134f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:26.161417 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-962b9d11-ac56-413a-b018-a30c65ea134f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:26.161908 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-962b9d11-ac56-413a-b018-a30c65ea134f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:26.162347 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-962b9d11-ac56-413a-b018-a30c65ea134f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:26.163098 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-962b9d11-ac56-413a-b018-a30c65ea134f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:26.163551 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-962b9d11-ac56-413a-b018-a30c65ea134f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:26.163979 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-962b9d11-ac56-413a-b018-a30c65ea134f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:26.343740 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-962b9d11-ac56-413a-b018-a30c65ea134f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:26.358049 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-962b9d11-ac56-413a-b018-a30c65ea134f tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.209766 Aug 08 16:57:26.359023 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 342/673] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:26 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:26.377986 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f558dc75-f788-4e5b-898e-395014a25b28 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:26.379149 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f558dc75-f788-4e5b-898e-395014a25b28 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:26.388254 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f558dc75-f788-4e5b-898e-395014a25b28 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:26.396032 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f558dc75-f788-4e5b-898e-395014a25b28 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:26.396032 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f558dc75-f788-4e5b-898e-395014a25b28 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:26.396032 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f558dc75-f788-4e5b-898e-395014a25b28 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:26.396032 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f558dc75-f788-4e5b-898e-395014a25b28 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:26.396691 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f558dc75-f788-4e5b-898e-395014a25b28 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:26.579462 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f558dc75-f788-4e5b-898e-395014a25b28 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:26.593888 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f558dc75-f788-4e5b-898e-395014a25b28 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:26.593888 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f558dc75-f788-4e5b-898e-395014a25b28 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:26.593888 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f558dc75-f788-4e5b-898e-395014a25b28 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1721 microversion: 2.20 time: 0.220005 Aug 08 16:57:26.594860 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 332/674] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:26 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:27.011821 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ff5a0892-e527-4231-b2c5-7434edd93a26 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:27.015834 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ff5a0892-e527-4231-b2c5-7434edd93a26 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:27.027504 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ff5a0892-e527-4231-b2c5-7434edd93a26 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:27.028259 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ff5a0892-e527-4231-b2c5-7434edd93a26 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:27.029032 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ff5a0892-e527-4231-b2c5-7434edd93a26 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:27.030309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ff5a0892-e527-4231-b2c5-7434edd93a26 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:27.031172 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ff5a0892-e527-4231-b2c5-7434edd93a26 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:27.031966 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ff5a0892-e527-4231-b2c5-7434edd93a26 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:27.073331 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-ff5a0892-e527-4231-b2c5-7434edd93a26 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lazy-loading 'flavor' on Instance uuid af731dd6-88e0-49bd-b38b-3b629bf771bb {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:57:27.088538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:27.095714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-eaf8bd00-db27-4579-82ee-e3a830024d06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:27.098624 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-eaf8bd00-db27-4579-82ee-e3a830024d06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:27.116177 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eaf8bd00-db27-4579-82ee-e3a830024d06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:27.116177 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eaf8bd00-db27-4579-82ee-e3a830024d06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:27.116177 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eaf8bd00-db27-4579-82ee-e3a830024d06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:27.116177 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eaf8bd00-db27-4579-82ee-e3a830024d06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:27.116807 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eaf8bd00-db27-4579-82ee-e3a830024d06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:27.116807 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eaf8bd00-db27-4579-82ee-e3a830024d06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:27.160992 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-eaf8bd00-db27-4579-82ee-e3a830024d06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069905 Aug 08 16:57:27.162335 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 333/675] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:27 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:27.394227 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fd8518b3-5326-4277-8b61-97ae0658d5c0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:27.394968 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fd8518b3-5326-4277-8b61-97ae0658d5c0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:27.402377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd8518b3-5326-4277-8b61-97ae0658d5c0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:27.402951 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd8518b3-5326-4277-8b61-97ae0658d5c0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:27.403451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd8518b3-5326-4277-8b61-97ae0658d5c0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:27.404277 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd8518b3-5326-4277-8b61-97ae0658d5c0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:27.404801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd8518b3-5326-4277-8b61-97ae0658d5c0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:27.405268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd8518b3-5326-4277-8b61-97ae0658d5c0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:27.468053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ff5a0892-e527-4231-b2c5-7434edd93a26 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "POST /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/action" status: 200 len: 32 microversion: 2.1 time: 0.464816 Aug 08 16:57:27.469825 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 343/676] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 16:57:27 2022] POST /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/action => generated 32 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 16:57:27.485074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4e88eefb-7b20-41eb-8658-fd90fdeec212 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:27.486352 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4e88eefb-7b20-41eb-8658-fd90fdeec212 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:27.496807 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4e88eefb-7b20-41eb-8658-fd90fdeec212 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:27.497673 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4e88eefb-7b20-41eb-8658-fd90fdeec212 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:27.498476 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4e88eefb-7b20-41eb-8658-fd90fdeec212 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:27.499901 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4e88eefb-7b20-41eb-8658-fd90fdeec212 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:27.500730 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4e88eefb-7b20-41eb-8658-fd90fdeec212 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:27.501514 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4e88eefb-7b20-41eb-8658-fd90fdeec212 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:27.591174 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fd8518b3-5326-4277-8b61-97ae0658d5c0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:27.606404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fd8518b3-5326-4277-8b61-97ae0658d5c0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.216290 Aug 08 16:57:27.607535 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 334/677] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:27 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:27.627946 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-69a198f4-b4da-49fd-b527-70037ee637e2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:27.629605 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-69a198f4-b4da-49fd-b527-70037ee637e2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:27.639808 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-69a198f4-b4da-49fd-b527-70037ee637e2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:27.640313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-69a198f4-b4da-49fd-b527-70037ee637e2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:27.640741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-69a198f4-b4da-49fd-b527-70037ee637e2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:27.641654 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-69a198f4-b4da-49fd-b527-70037ee637e2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:27.642116 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-69a198f4-b4da-49fd-b527-70037ee637e2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:27.642746 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-69a198f4-b4da-49fd-b527-70037ee637e2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:27.740561 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4e88eefb-7b20-41eb-8658-fd90fdeec212 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:27.771945 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4e88eefb-7b20-41eb-8658-fd90fdeec212 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.294893 Aug 08 16:57:27.773187 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 344/678] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:27 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:27.889569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-69a198f4-b4da-49fd-b527-70037ee637e2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:27.903384 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-69a198f4-b4da-49fd-b527-70037ee637e2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:27.905534 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-69a198f4-b4da-49fd-b527-70037ee637e2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:27.906962 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-69a198f4-b4da-49fd-b527-70037ee637e2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1724 microversion: 2.20 time: 0.284951 Aug 08 16:57:27.907651 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 335/679] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:27 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:57:27.944015 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f97964ea-d0b8-4943-a946-4e86b5b571aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b83a465a-0871-4926-84ec-b8357500084b"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:27.949766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f97964ea-d0b8-4943-a946-4e86b5b571aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:27.959491 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f97964ea-d0b8-4943-a946-4e86b5b571aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:27.960295 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f97964ea-d0b8-4943-a946-4e86b5b571aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:27.960771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f97964ea-d0b8-4943-a946-4e86b5b571aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:27.963256 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f97964ea-d0b8-4943-a946-4e86b5b571aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:27.963521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f97964ea-d0b8-4943-a946-4e86b5b571aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:27.964266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f97964ea-d0b8-4943-a946-4e86b5b571aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:28.185478 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c4306383-b475-4b76-a443-94bf71c3ba81 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:28.188932 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c4306383-b475-4b76-a443-94bf71c3ba81 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:28.197576 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4306383-b475-4b76-a443-94bf71c3ba81 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:28.199016 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4306383-b475-4b76-a443-94bf71c3ba81 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:28.199947 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4306383-b475-4b76-a443-94bf71c3ba81 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:28.200860 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4306383-b475-4b76-a443-94bf71c3ba81 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:28.201320 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4306383-b475-4b76-a443-94bf71c3ba81 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:28.201827 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4306383-b475-4b76-a443-94bf71c3ba81 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:28.241593 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c4306383-b475-4b76-a443-94bf71c3ba81 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061106 Aug 08 16:57:28.243296 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 336/680] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:28 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:28.644836 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-175dd16b-78b0-49ab-813a-1dd5af7177b2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:28.645460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-175dd16b-78b0-49ab-813a-1dd5af7177b2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:28.651942 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-175dd16b-78b0-49ab-813a-1dd5af7177b2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:28.652485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-175dd16b-78b0-49ab-813a-1dd5af7177b2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:28.653004 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-175dd16b-78b0-49ab-813a-1dd5af7177b2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:28.653798 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-175dd16b-78b0-49ab-813a-1dd5af7177b2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:28.654308 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-175dd16b-78b0-49ab-813a-1dd5af7177b2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:28.654815 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-175dd16b-78b0-49ab-813a-1dd5af7177b2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:28.829514 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-175dd16b-78b0-49ab-813a-1dd5af7177b2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:28.845099 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-175dd16b-78b0-49ab-813a-1dd5af7177b2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.203706 Aug 08 16:57:28.852853 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 337/681] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:28 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:28.856081 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1ff3932d-39c1-4fc3-a15c-f5941afc28a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:28.857202 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1ff3932d-39c1-4fc3-a15c-f5941afc28a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:28.869164 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ff3932d-39c1-4fc3-a15c-f5941afc28a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:28.870017 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ff3932d-39c1-4fc3-a15c-f5941afc28a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:28.870948 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ff3932d-39c1-4fc3-a15c-f5941afc28a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:28.872234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ff3932d-39c1-4fc3-a15c-f5941afc28a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:28.873114 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ff3932d-39c1-4fc3-a15c-f5941afc28a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:28.874660 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ff3932d-39c1-4fc3-a15c-f5941afc28a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:28.883063 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=100 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:29.229833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1ff3932d-39c1-4fc3-a15c-f5941afc28a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:29.241253 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1ff3932d-39c1-4fc3-a15c-f5941afc28a0 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.393367 Aug 08 16:57:29.241960 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 338/682] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:28 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:29.257131 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-596dc338-6ce5-4342-8f75-ed14b69a796e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:29.267664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-596dc338-6ce5-4342-8f75-ed14b69a796e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:29.282047 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-596dc338-6ce5-4342-8f75-ed14b69a796e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:29.283305 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-596dc338-6ce5-4342-8f75-ed14b69a796e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:29.286506 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-596dc338-6ce5-4342-8f75-ed14b69a796e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:29.290313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-596dc338-6ce5-4342-8f75-ed14b69a796e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:29.291287 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-596dc338-6ce5-4342-8f75-ed14b69a796e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:29.292162 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-596dc338-6ce5-4342-8f75-ed14b69a796e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:29.334595 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f97964ea-d0b8-4943-a946-4e86b5b571aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "POST /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.399521 Aug 08 16:57:29.335846 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 345/683] 10.222.0.13 () {62 vars in 1364 bytes} [Mon Aug 8 16:57:27 2022] POST /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments => generated 188 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:57:29.339867 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-596dc338-6ce5-4342-8f75-ed14b69a796e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087411 Aug 08 16:57:29.340852 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 339/684] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:57:29 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 16:57:29.430980 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-70fd2de8-1ed3-45a1-96f5-b6edde8e4ab7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:29.431842 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-70fd2de8-1ed3-45a1-96f5-b6edde8e4ab7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:29.443794 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70fd2de8-1ed3-45a1-96f5-b6edde8e4ab7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:29.444686 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70fd2de8-1ed3-45a1-96f5-b6edde8e4ab7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:29.445978 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70fd2de8-1ed3-45a1-96f5-b6edde8e4ab7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:29.447639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70fd2de8-1ed3-45a1-96f5-b6edde8e4ab7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:29.448284 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70fd2de8-1ed3-45a1-96f5-b6edde8e4ab7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:29.449063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70fd2de8-1ed3-45a1-96f5-b6edde8e4ab7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:29.503546 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-70fd2de8-1ed3-45a1-96f5-b6edde8e4ab7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:57:29.543313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8a5a5a09-31e2-4396-b340-bca74d5b670e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:29.544225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8a5a5a09-31e2-4396-b340-bca74d5b670e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:29.550845 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8a5a5a09-31e2-4396-b340-bca74d5b670e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:29.551492 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8a5a5a09-31e2-4396-b340-bca74d5b670e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:29.551930 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8a5a5a09-31e2-4396-b340-bca74d5b670e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:29.552644 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8a5a5a09-31e2-4396-b340-bca74d5b670e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:29.553097 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8a5a5a09-31e2-4396-b340-bca74d5b670e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:29.553543 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8a5a5a09-31e2-4396-b340-bca74d5b670e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:29.659684 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8a5a5a09-31e2-4396-b340-bca74d5b670e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130235) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 16:57:29.924840 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-70fd2de8-1ed3-45a1-96f5-b6edde8e4ab7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 204 len: 0 microversion: 2.1 time: 0.501774 Aug 08 16:57:29.925841 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 346/685] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:57:29 2022] DELETE /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 16:57:29.939325 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e65730b3-6ca0-4e56-82ce-111091d83d1b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:29.942795 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e65730b3-6ca0-4e56-82ce-111091d83d1b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:29.960971 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e65730b3-6ca0-4e56-82ce-111091d83d1b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:29.962156 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e65730b3-6ca0-4e56-82ce-111091d83d1b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:29.963113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e65730b3-6ca0-4e56-82ce-111091d83d1b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:29.965397 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e65730b3-6ca0-4e56-82ce-111091d83d1b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:29.967732 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e65730b3-6ca0-4e56-82ce-111091d83d1b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:29.968806 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e65730b3-6ca0-4e56-82ce-111091d83d1b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:30.024700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8a5a5a09-31e2-4396-b340-bca74d5b670e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "POST /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/action" status: 202 len: 0 microversion: 2.20 time: 0.486603 Aug 08 16:57:30.028396 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 340/686] 10.222.0.13 () {62 vars in 1319 bytes} [Mon Aug 8 16:57:29 2022] POST /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 08 16:57:30.034460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-75ff6c40-fd77-4353-a67a-27947e2a86bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:30.035449 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-75ff6c40-fd77-4353-a67a-27947e2a86bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:30.046871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75ff6c40-fd77-4353-a67a-27947e2a86bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:30.047820 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75ff6c40-fd77-4353-a67a-27947e2a86bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:30.048664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75ff6c40-fd77-4353-a67a-27947e2a86bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:30.050081 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75ff6c40-fd77-4353-a67a-27947e2a86bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:30.051673 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75ff6c40-fd77-4353-a67a-27947e2a86bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:30.051673 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-75ff6c40-fd77-4353-a67a-27947e2a86bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:30.174164 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e65730b3-6ca0-4e56-82ce-111091d83d1b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:30.194191 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e65730b3-6ca0-4e56-82ce-111091d83d1b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.254639 Aug 08 16:57:30.194191 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 347/687] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:29 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:30.201359 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b86ceb20-47e2-402c-b30a-0c14190fadde tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:30.202319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b86ceb20-47e2-402c-b30a-0c14190fadde tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:30.212628 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b86ceb20-47e2-402c-b30a-0c14190fadde tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:30.213207 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b86ceb20-47e2-402c-b30a-0c14190fadde tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:30.213681 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b86ceb20-47e2-402c-b30a-0c14190fadde tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:30.214422 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b86ceb20-47e2-402c-b30a-0c14190fadde tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:30.214905 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b86ceb20-47e2-402c-b30a-0c14190fadde tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:30.215331 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b86ceb20-47e2-402c-b30a-0c14190fadde tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:30.300002 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-75ff6c40-fd77-4353-a67a-27947e2a86bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:30.309928 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-75ff6c40-fd77-4353-a67a-27947e2a86bd tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1678 microversion: 2.1 time: 0.282336 Aug 08 16:57:30.310870 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 341/688] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:30 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1678 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:30.316226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fddd6ea5-6376-4015-8076-119973051f10 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:30.317493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fddd6ea5-6376-4015-8076-119973051f10 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:30.326170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fddd6ea5-6376-4015-8076-119973051f10 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:30.327123 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fddd6ea5-6376-4015-8076-119973051f10 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:30.327838 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fddd6ea5-6376-4015-8076-119973051f10 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:30.329091 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fddd6ea5-6376-4015-8076-119973051f10 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:30.329826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fddd6ea5-6376-4015-8076-119973051f10 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:30.330523 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fddd6ea5-6376-4015-8076-119973051f10 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:30.415050 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b86ceb20-47e2-402c-b30a-0c14190fadde tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:30.425823 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b86ceb20-47e2-402c-b30a-0c14190fadde tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:30.427561 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b86ceb20-47e2-402c-b30a-0c14190fadde tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:30.429148 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b86ceb20-47e2-402c-b30a-0c14190fadde tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1750 microversion: 2.20 time: 0.243568 Aug 08 16:57:30.430966 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 348/689] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:30 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1750 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:30.435909 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e25c3aab-5087-4284-8616-7beb3f15a104 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:30.436897 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e25c3aab-5087-4284-8616-7beb3f15a104 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:30.444415 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e25c3aab-5087-4284-8616-7beb3f15a104 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:30.445288 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e25c3aab-5087-4284-8616-7beb3f15a104 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:30.446946 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e25c3aab-5087-4284-8616-7beb3f15a104 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:30.448290 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e25c3aab-5087-4284-8616-7beb3f15a104 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:30.448836 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e25c3aab-5087-4284-8616-7beb3f15a104 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:30.449484 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e25c3aab-5087-4284-8616-7beb3f15a104 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:30.479447 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e25c3aab-5087-4284-8616-7beb3f15a104 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:57:30.786829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fddd6ea5-6376-4015-8076-119973051f10 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:30.797495 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fddd6ea5-6376-4015-8076-119973051f10 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.484998 Aug 08 16:57:30.798200 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 342/690] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:30 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:30.809963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e25c3aab-5087-4284-8616-7beb3f15a104 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "DELETE /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 204 len: 0 microversion: 2.1 time: 0.377476 Aug 08 16:57:30.811180 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 349/691] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:57:30 2022] DELETE /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 16:57:30.830396 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-85888599-c77c-4eb2-aee3-9f10b836aff0 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:30.830396 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-85888599-c77c-4eb2-aee3-9f10b836aff0 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:30.830396 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-85888599-c77c-4eb2-aee3-9f10b836aff0 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:30.830396 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-85888599-c77c-4eb2-aee3-9f10b836aff0 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:30.831015 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-85888599-c77c-4eb2-aee3-9f10b836aff0 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:30.831846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-85888599-c77c-4eb2-aee3-9f10b836aff0 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:30.831846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-85888599-c77c-4eb2-aee3-9f10b836aff0 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:30.832286 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-85888599-c77c-4eb2-aee3-9f10b836aff0 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:31.000618 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-85888599-c77c-4eb2-aee3-9f10b836aff0 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:31.009762 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-85888599-c77c-4eb2-aee3-9f10b836aff0 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1513 microversion: 2.1 time: 0.193867 Aug 08 16:57:31.010390 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 343/692] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:30 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:31.223528 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d04e8623-d9af-42e8-a0e3-269afdc0aa6d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:31.224360 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d04e8623-d9af-42e8-a0e3-269afdc0aa6d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:31.232600 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d04e8623-d9af-42e8-a0e3-269afdc0aa6d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:31.233090 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d04e8623-d9af-42e8-a0e3-269afdc0aa6d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:31.233528 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d04e8623-d9af-42e8-a0e3-269afdc0aa6d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:31.234249 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d04e8623-d9af-42e8-a0e3-269afdc0aa6d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:31.234762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d04e8623-d9af-42e8-a0e3-269afdc0aa6d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:31.235189 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d04e8623-d9af-42e8-a0e3-269afdc0aa6d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:31.351002 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-439c402c-8b2c-4df7-9f00-54d34048209a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:31.352998 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-439c402c-8b2c-4df7-9f00-54d34048209a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:31.360341 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-439c402c-8b2c-4df7-9f00-54d34048209a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:31.361806 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-439c402c-8b2c-4df7-9f00-54d34048209a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:31.361806 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-439c402c-8b2c-4df7-9f00-54d34048209a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:31.362707 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-439c402c-8b2c-4df7-9f00-54d34048209a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:31.362707 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-439c402c-8b2c-4df7-9f00-54d34048209a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:31.363314 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-439c402c-8b2c-4df7-9f00-54d34048209a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:31.459533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d04e8623-d9af-42e8-a0e3-269afdc0aa6d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:31.473467 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d04e8623-d9af-42e8-a0e3-269afdc0aa6d tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.254904 Aug 08 16:57:31.474449 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 350/693] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:31 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:31.485434 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-65648caa-ac20-42ae-835a-bb52061d8378 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:31.488756 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-65648caa-ac20-42ae-835a-bb52061d8378 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:31.501228 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-65648caa-ac20-42ae-835a-bb52061d8378 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:31.501951 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-65648caa-ac20-42ae-835a-bb52061d8378 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:31.502742 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-65648caa-ac20-42ae-835a-bb52061d8378 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:31.504147 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-65648caa-ac20-42ae-835a-bb52061d8378 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:31.504928 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-65648caa-ac20-42ae-835a-bb52061d8378 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:31.505677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-65648caa-ac20-42ae-835a-bb52061d8378 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:31.529019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-439c402c-8b2c-4df7-9f00-54d34048209a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:31.539442 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-439c402c-8b2c-4df7-9f00-54d34048209a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1678 microversion: 2.1 time: 0.190273 Aug 08 16:57:31.539442 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 344/694] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:31 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:31.658828 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-65648caa-ac20-42ae-835a-bb52061d8378 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:31.668205 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-65648caa-ac20-42ae-835a-bb52061d8378 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:31.669790 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-65648caa-ac20-42ae-835a-bb52061d8378 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:31.670951 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-65648caa-ac20-42ae-835a-bb52061d8378 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1750 microversion: 2.20 time: 0.194938 Aug 08 16:57:31.671517 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 351/695] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:31 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1750 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:31.819746 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c406d5ad-0814-4ec5-ae52-f4557e99b027 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:31.821056 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c406d5ad-0814-4ec5-ae52-f4557e99b027 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:31.828700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c406d5ad-0814-4ec5-ae52-f4557e99b027 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:31.829271 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c406d5ad-0814-4ec5-ae52-f4557e99b027 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:31.829793 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c406d5ad-0814-4ec5-ae52-f4557e99b027 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:31.830613 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c406d5ad-0814-4ec5-ae52-f4557e99b027 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:31.831198 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c406d5ad-0814-4ec5-ae52-f4557e99b027 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:31.831677 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c406d5ad-0814-4ec5-ae52-f4557e99b027 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:31.980455 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c406d5ad-0814-4ec5-ae52-f4557e99b027 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:31.989417 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c406d5ad-0814-4ec5-ae52-f4557e99b027 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.173877 Aug 08 16:57:31.992959 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 345/696] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:31 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:32.031242 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2408ad4d-bade-4fe3-b1fe-21468f8e13b3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:32.031771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2408ad4d-bade-4fe3-b1fe-21468f8e13b3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:32.033918 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=3 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:32.039337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2408ad4d-bade-4fe3-b1fe-21468f8e13b3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:32.040101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2408ad4d-bade-4fe3-b1fe-21468f8e13b3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:32.044572 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2408ad4d-bade-4fe3-b1fe-21468f8e13b3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:32.044572 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2408ad4d-bade-4fe3-b1fe-21468f8e13b3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:32.044572 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2408ad4d-bade-4fe3-b1fe-21468f8e13b3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:32.044572 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2408ad4d-bade-4fe3-b1fe-21468f8e13b3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:32.200389 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2408ad4d-bade-4fe3-b1fe-21468f8e13b3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:32.203654 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=8,nova_cell1:INSERT=6 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:32.212503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2408ad4d-bade-4fe3-b1fe-21468f8e13b3 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1513 microversion: 2.1 time: 0.185313 Aug 08 16:57:32.213083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 352/697] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:32 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:32.497690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7a5992dc-2f4e-4706-8a98-06314fd5e679 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:32.498407 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7a5992dc-2f4e-4706-8a98-06314fd5e679 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:32.505259 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a5992dc-2f4e-4706-8a98-06314fd5e679 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:32.505757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a5992dc-2f4e-4706-8a98-06314fd5e679 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:32.506207 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a5992dc-2f4e-4706-8a98-06314fd5e679 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:32.506955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a5992dc-2f4e-4706-8a98-06314fd5e679 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:32.507419 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a5992dc-2f4e-4706-8a98-06314fd5e679 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:32.508478 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a5992dc-2f4e-4706-8a98-06314fd5e679 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:32.559622 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ca5859ea-df4e-4c83-9466-97237e9e38c5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:32.561399 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ca5859ea-df4e-4c83-9466-97237e9e38c5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:32.573787 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ca5859ea-df4e-4c83-9466-97237e9e38c5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:32.574295 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ca5859ea-df4e-4c83-9466-97237e9e38c5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:32.574775 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ca5859ea-df4e-4c83-9466-97237e9e38c5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:32.575504 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ca5859ea-df4e-4c83-9466-97237e9e38c5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:32.575962 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ca5859ea-df4e-4c83-9466-97237e9e38c5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:32.576391 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ca5859ea-df4e-4c83-9466-97237e9e38c5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:32.692909 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7a5992dc-2f4e-4706-8a98-06314fd5e679 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:32.701511 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7a5992dc-2f4e-4706-8a98-06314fd5e679 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1678 microversion: 2.1 time: 0.207720 Aug 08 16:57:32.702110 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 346/698] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:32 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:32.709484 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f0355ff3-2ade-4f52-8485-9aa78ead1219 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:32.709484 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f0355ff3-2ade-4f52-8485-9aa78ead1219 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:32.718103 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f0355ff3-2ade-4f52-8485-9aa78ead1219 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:32.718866 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f0355ff3-2ade-4f52-8485-9aa78ead1219 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:32.719671 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f0355ff3-2ade-4f52-8485-9aa78ead1219 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:32.720942 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f0355ff3-2ade-4f52-8485-9aa78ead1219 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:32.721774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f0355ff3-2ade-4f52-8485-9aa78ead1219 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:32.722502 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f0355ff3-2ade-4f52-8485-9aa78ead1219 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:32.748269 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ca5859ea-df4e-4c83-9466-97237e9e38c5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:32.756783 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ca5859ea-df4e-4c83-9466-97237e9e38c5 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1678 microversion: 2.1 time: 0.202054 Aug 08 16:57:32.757385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 353/699] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:32 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:32.876685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f0355ff3-2ade-4f52-8485-9aa78ead1219 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:32.887249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f0355ff3-2ade-4f52-8485-9aa78ead1219 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:32.889095 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f0355ff3-2ade-4f52-8485-9aa78ead1219 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:32.890456 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f0355ff3-2ade-4f52-8485-9aa78ead1219 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1750 microversion: 2.20 time: 0.187347 Aug 08 16:57:32.891077 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 347/700] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:32 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1750 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:33.014639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ded2e51b-e3ed-43a4-9031-efa96a0c30b5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:33.015451 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ded2e51b-e3ed-43a4-9031-efa96a0c30b5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:33.022947 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ded2e51b-e3ed-43a4-9031-efa96a0c30b5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:33.023601 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ded2e51b-e3ed-43a4-9031-efa96a0c30b5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:33.024246 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ded2e51b-e3ed-43a4-9031-efa96a0c30b5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:33.025111 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ded2e51b-e3ed-43a4-9031-efa96a0c30b5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:33.025575 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ded2e51b-e3ed-43a4-9031-efa96a0c30b5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:33.026007 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ded2e51b-e3ed-43a4-9031-efa96a0c30b5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:33.172749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ded2e51b-e3ed-43a4-9031-efa96a0c30b5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:33.182519 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ded2e51b-e3ed-43a4-9031-efa96a0c30b5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.172604 Aug 08 16:57:33.183269 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 354/701] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:33 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:33.234523 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-79e045ee-318f-4c81-99ca-e0ad790ce92f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:33.235225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-79e045ee-318f-4c81-99ca-e0ad790ce92f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:33.242060 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-79e045ee-318f-4c81-99ca-e0ad790ce92f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:33.243210 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-79e045ee-318f-4c81-99ca-e0ad790ce92f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:33.243664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-79e045ee-318f-4c81-99ca-e0ad790ce92f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:33.244401 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-79e045ee-318f-4c81-99ca-e0ad790ce92f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:33.244863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-79e045ee-318f-4c81-99ca-e0ad790ce92f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:33.245296 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-79e045ee-318f-4c81-99ca-e0ad790ce92f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:33.408012 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-79e045ee-318f-4c81-99ca-e0ad790ce92f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:33.416880 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-79e045ee-318f-4c81-99ca-e0ad790ce92f tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1513 microversion: 2.1 time: 0.186322 Aug 08 16:57:33.417554 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 348/702] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:33 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:33.723830 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-30881a63-263b-4acc-9c20-b50248f1bad6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:33.724391 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-30881a63-263b-4acc-9c20-b50248f1bad6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:33.731515 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-30881a63-263b-4acc-9c20-b50248f1bad6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:33.732075 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-30881a63-263b-4acc-9c20-b50248f1bad6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:33.732457 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-30881a63-263b-4acc-9c20-b50248f1bad6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:33.733188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-30881a63-263b-4acc-9c20-b50248f1bad6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:33.733649 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-30881a63-263b-4acc-9c20-b50248f1bad6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:33.734079 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-30881a63-263b-4acc-9c20-b50248f1bad6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:33.785512 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ae98702d-91fc-4597-b29c-3c9832e76c8d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:33.786364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ae98702d-91fc-4597-b29c-3c9832e76c8d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:33.794356 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae98702d-91fc-4597-b29c-3c9832e76c8d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:33.794882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae98702d-91fc-4597-b29c-3c9832e76c8d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:33.795327 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae98702d-91fc-4597-b29c-3c9832e76c8d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:33.796071 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae98702d-91fc-4597-b29c-3c9832e76c8d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:33.796538 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae98702d-91fc-4597-b29c-3c9832e76c8d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:33.796964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae98702d-91fc-4597-b29c-3c9832e76c8d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:33.895639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-30881a63-263b-4acc-9c20-b50248f1bad6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:33.905593 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-30881a63-263b-4acc-9c20-b50248f1bad6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1655 microversion: 2.1 time: 0.185503 Aug 08 16:57:33.906699 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 355/703] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:33 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1655 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:33.936351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-684d2792-a0c6-46ac-a464-84800389ec3b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:33.948197 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-684d2792-a0c6-46ac-a464-84800389ec3b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:33.949096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-684d2792-a0c6-46ac-a464-84800389ec3b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:33.949901 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-684d2792-a0c6-46ac-a464-84800389ec3b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:33.984611 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ae98702d-91fc-4597-b29c-3c9832e76c8d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:33.989746 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-684d2792-a0c6-46ac-a464-84800389ec3b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Going to try to start instance {{(pid=130236) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 16:57:33.995381 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ae98702d-91fc-4597-b29c-3c9832e76c8d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1678 microversion: 2.1 time: 0.216465 Aug 08 16:57:33.996291 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 349/704] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:33 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:34.003987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ae295ad6-1d83-470f-afc3-a1ab7b702c49 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:34.004881 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ae295ad6-1d83-470f-afc3-a1ab7b702c49 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:34.013190 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae295ad6-1d83-470f-afc3-a1ab7b702c49 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:34.017141 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae295ad6-1d83-470f-afc3-a1ab7b702c49 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:34.017141 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae295ad6-1d83-470f-afc3-a1ab7b702c49 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:34.017141 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae295ad6-1d83-470f-afc3-a1ab7b702c49 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:34.017141 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae295ad6-1d83-470f-afc3-a1ab7b702c49 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:34.018295 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae295ad6-1d83-470f-afc3-a1ab7b702c49 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:34.178723 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ae295ad6-1d83-470f-afc3-a1ab7b702c49 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:34.196850 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ae295ad6-1d83-470f-afc3-a1ab7b702c49 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:34.200246 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ae295ad6-1d83-470f-afc3-a1ab7b702c49 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:34.202607 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ae295ad6-1d83-470f-afc3-a1ab7b702c49 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1750 microversion: 2.20 time: 0.204630 Aug 08 16:57:34.203631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 350/705] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:33 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1750 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:34.212669 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c971367d-758f-4066-977e-9a176dc1971a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:34.213462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-684d2792-a0c6-46ac-a464-84800389ec3b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "POST /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/action" status: 202 len: 0 microversion: 2.1 time: 0.285927 Aug 08 16:57:34.213784 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c971367d-758f-4066-977e-9a176dc1971a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:34.214391 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 356/706] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 16:57:33 2022] POST /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:57:34.226027 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c971367d-758f-4066-977e-9a176dc1971a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:34.227801 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1f806fd2-d239-4eaf-a074-b0d74dbc5a47 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:34.228121 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c971367d-758f-4066-977e-9a176dc1971a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:34.228906 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c971367d-758f-4066-977e-9a176dc1971a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:34.229069 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1f806fd2-d239-4eaf-a074-b0d74dbc5a47 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:34.230302 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c971367d-758f-4066-977e-9a176dc1971a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:34.231229 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c971367d-758f-4066-977e-9a176dc1971a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:34.231947 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c971367d-758f-4066-977e-9a176dc1971a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:34.239596 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1f806fd2-d239-4eaf-a074-b0d74dbc5a47 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:34.240445 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1f806fd2-d239-4eaf-a074-b0d74dbc5a47 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:34.241218 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1f806fd2-d239-4eaf-a074-b0d74dbc5a47 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:34.242531 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1f806fd2-d239-4eaf-a074-b0d74dbc5a47 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:34.243224 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1f806fd2-d239-4eaf-a074-b0d74dbc5a47 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:34.243983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1f806fd2-d239-4eaf-a074-b0d74dbc5a47 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:34.428387 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1f806fd2-d239-4eaf-a074-b0d74dbc5a47 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:34.438687 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1f806fd2-d239-4eaf-a074-b0d74dbc5a47 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1664 microversion: 2.1 time: 0.218946 Aug 08 16:57:34.439303 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 357/707] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:34 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1664 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:34.446501 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c971367d-758f-4066-977e-9a176dc1971a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:34.449534 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e36e5f57-1694-42c2-bd01-79a0497ed41e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:34.450696 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e36e5f57-1694-42c2-bd01-79a0497ed41e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:34.455897 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c971367d-758f-4066-977e-9a176dc1971a tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.250771 Aug 08 16:57:34.456781 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 351/708] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:34 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:34.462561 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e36e5f57-1694-42c2-bd01-79a0497ed41e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:34.463456 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e36e5f57-1694-42c2-bd01-79a0497ed41e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:34.464243 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e36e5f57-1694-42c2-bd01-79a0497ed41e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:34.465498 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e36e5f57-1694-42c2-bd01-79a0497ed41e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:34.466366 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e36e5f57-1694-42c2-bd01-79a0497ed41e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:34.467262 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e36e5f57-1694-42c2-bd01-79a0497ed41e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:34.628094 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e36e5f57-1694-42c2-bd01-79a0497ed41e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:34.637150 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e36e5f57-1694-42c2-bd01-79a0497ed41e tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1513 microversion: 2.1 time: 0.196744 Aug 08 16:57:34.637748 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 358/709] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:34 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:35.028716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f36790dc-68b6-47fe-9dbc-23cf72d47150 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:35.029430 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f36790dc-68b6-47fe-9dbc-23cf72d47150 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:35.037360 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f36790dc-68b6-47fe-9dbc-23cf72d47150 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:35.037922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f36790dc-68b6-47fe-9dbc-23cf72d47150 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:35.038403 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f36790dc-68b6-47fe-9dbc-23cf72d47150 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:35.039260 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f36790dc-68b6-47fe-9dbc-23cf72d47150 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:35.039801 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f36790dc-68b6-47fe-9dbc-23cf72d47150 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:35.040549 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f36790dc-68b6-47fe-9dbc-23cf72d47150 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:35.195867 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f36790dc-68b6-47fe-9dbc-23cf72d47150 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:35.204510 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f36790dc-68b6-47fe-9dbc-23cf72d47150 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1678 microversion: 2.1 time: 0.179919 Aug 08 16:57:35.205106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 352/710] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:35 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:35.233779 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6b5cbfbc-62a0-4bea-a0f2-4060a0b147d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:35.234960 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6b5cbfbc-62a0-4bea-a0f2-4060a0b147d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:35.248986 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b5cbfbc-62a0-4bea-a0f2-4060a0b147d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:35.249892 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b5cbfbc-62a0-4bea-a0f2-4060a0b147d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:35.252630 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b5cbfbc-62a0-4bea-a0f2-4060a0b147d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:35.253993 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b5cbfbc-62a0-4bea-a0f2-4060a0b147d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:35.255063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b5cbfbc-62a0-4bea-a0f2-4060a0b147d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:35.255854 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6b5cbfbc-62a0-4bea-a0f2-4060a0b147d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:35.468445 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-637f5978-f6fb-46a6-bef0-be42823268c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:35.469456 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-637f5978-f6fb-46a6-bef0-be42823268c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:35.478173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:35.488433 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-637f5978-f6fb-46a6-bef0-be42823268c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:35.489586 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-637f5978-f6fb-46a6-bef0-be42823268c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:35.490354 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-637f5978-f6fb-46a6-bef0-be42823268c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:35.491512 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-637f5978-f6fb-46a6-bef0-be42823268c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:35.492841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-637f5978-f6fb-46a6-bef0-be42823268c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:35.493513 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-637f5978-f6fb-46a6-bef0-be42823268c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:35.625319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6b5cbfbc-62a0-4bea-a0f2-4060a0b147d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:35.641498 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6b5cbfbc-62a0-4bea-a0f2-4060a0b147d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:35.643693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6b5cbfbc-62a0-4bea-a0f2-4060a0b147d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:35.645962 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6b5cbfbc-62a0-4bea-a0f2-4060a0b147d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1752 microversion: 2.20 time: 0.420695 Aug 08 16:57:35.647857 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 359/711] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:35 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1752 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:35.659196 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e43f63f4-e786-4857-bf67-07de154828ee tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:35.660877 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e43f63f4-e786-4857-bf67-07de154828ee tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:35.675891 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e43f63f4-e786-4857-bf67-07de154828ee tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:35.677191 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e43f63f4-e786-4857-bf67-07de154828ee tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:35.679566 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e43f63f4-e786-4857-bf67-07de154828ee tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:35.681454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e43f63f4-e786-4857-bf67-07de154828ee tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:35.682608 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e43f63f4-e786-4857-bf67-07de154828ee tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:35.683684 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e43f63f4-e786-4857-bf67-07de154828ee tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:36.000750 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e43f63f4-e786-4857-bf67-07de154828ee tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:36.016434 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e43f63f4-e786-4857-bf67-07de154828ee tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.366055 Aug 08 16:57:36.038611 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 360/712] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:35 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:36.038611 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-747f6396-f47b-401b-96fc-0cbb925825a2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:36.038611 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-747f6396-f47b-401b-96fc-0cbb925825a2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:36.052298 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-747f6396-f47b-401b-96fc-0cbb925825a2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:36.052679 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-747f6396-f47b-401b-96fc-0cbb925825a2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:36.053380 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-747f6396-f47b-401b-96fc-0cbb925825a2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:36.055459 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-747f6396-f47b-401b-96fc-0cbb925825a2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:36.056311 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-747f6396-f47b-401b-96fc-0cbb925825a2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:36.057582 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-747f6396-f47b-401b-96fc-0cbb925825a2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:36.244585 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-637f5978-f6fb-46a6-bef0-be42823268c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:36.251152 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:36.277721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-637f5978-f6fb-46a6-bef0-be42823268c3 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1664 microversion: 2.1 time: 0.800752 Aug 08 16:57:36.277721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 353/713] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:35 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1664 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:36.277721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-372fd277-c1b3-4787-b004-9ad749c7fe9f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:36.277721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-372fd277-c1b3-4787-b004-9ad749c7fe9f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:36.286180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-372fd277-c1b3-4787-b004-9ad749c7fe9f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:36.287180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-372fd277-c1b3-4787-b004-9ad749c7fe9f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:36.287897 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-372fd277-c1b3-4787-b004-9ad749c7fe9f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:36.289458 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-372fd277-c1b3-4787-b004-9ad749c7fe9f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:36.291013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-372fd277-c1b3-4787-b004-9ad749c7fe9f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:36.292513 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-372fd277-c1b3-4787-b004-9ad749c7fe9f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:36.306069 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-747f6396-f47b-401b-96fc-0cbb925825a2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:36.325891 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-747f6396-f47b-401b-96fc-0cbb925825a2 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1513 microversion: 2.1 time: 0.296393 Aug 08 16:57:36.326497 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 361/714] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:36 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:36.475803 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-9447c46a-da14-476c-a4c8-f7f1a305ae87 req-54dc0ae8-7070-474e-8a3e-703b130c72c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00980f58-f4e7-4ca4-9f21-d8d665401320", "name": "network-vif-deleted", "tag": "b7424995-46e4-4c29-8e59-ff263dfa8afd"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:36.502817 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-9447c46a-da14-476c-a4c8-f7f1a305ae87 req-54dc0ae8-7070-474e-8a3e-703b130c72c3 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:36.503572 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-9447c46a-da14-476c-a4c8-f7f1a305ae87 req-54dc0ae8-7070-474e-8a3e-703b130c72c3 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:36.504252 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-9447c46a-da14-476c-a4c8-f7f1a305ae87 req-54dc0ae8-7070-474e-8a3e-703b130c72c3 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:36.525535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-9447c46a-da14-476c-a4c8-f7f1a305ae87 req-54dc0ae8-7070-474e-8a3e-703b130c72c3 service nova] Creating event network-vif-deleted:b7424995-46e4-4c29-8e59-ff263dfa8afd for instance 00980f58-f4e7-4ca4-9f21-d8d665401320 on hv-cinder-85220 Aug 08 16:57:36.533323 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-9447c46a-da14-476c-a4c8-f7f1a305ae87 req-54dc0ae8-7070-474e-8a3e-703b130c72c3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145203 Aug 08 16:57:36.534438 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 362/715] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:57:36.687306 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-372fd277-c1b3-4787-b004-9ad749c7fe9f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:36.705072 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-372fd277-c1b3-4787-b004-9ad749c7fe9f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1678 microversion: 2.1 time: 0.437871 Aug 08 16:57:36.707035 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 354/716] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:36 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1678 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:36.718606 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-10c2120a-e673-4a30-b5d3-0445e1c72449 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:36.720722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-e3c0261b-dcb1-4cb2-a376-93c3e1ece973 req-367d69a4-4c33-458e-b79b-2325722d3714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0affcec-8e4c-461a-ac29-5ac8d4fd92bd", "name": "network-vif-unplugged", "status": "completed", "tag": "412ef6d6-1ffe-43de-9f26-f0beb2a5afac"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:36.721975 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-10c2120a-e673-4a30-b5d3-0445e1c72449 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:36.782812 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-10c2120a-e673-4a30-b5d3-0445e1c72449 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:36.782812 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-10c2120a-e673-4a30-b5d3-0445e1c72449 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:36.782812 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-10c2120a-e673-4a30-b5d3-0445e1c72449 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:36.783363 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e3c0261b-dcb1-4cb2-a376-93c3e1ece973 req-367d69a4-4c33-458e-b79b-2325722d3714 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:36.783363 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e3c0261b-dcb1-4cb2-a376-93c3e1ece973 req-367d69a4-4c33-458e-b79b-2325722d3714 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:36.783363 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-e3c0261b-dcb1-4cb2-a376-93c3e1ece973 req-367d69a4-4c33-458e-b79b-2325722d3714 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:36.783813 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-10c2120a-e673-4a30-b5d3-0445e1c72449 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:36.783813 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-10c2120a-e673-4a30-b5d3-0445e1c72449 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:36.783813 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-10c2120a-e673-4a30-b5d3-0445e1c72449 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:36.784539 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-e3c0261b-dcb1-4cb2-a376-93c3e1ece973 req-367d69a4-4c33-458e-b79b-2325722d3714 service nova] Creating event network-vif-unplugged:412ef6d6-1ffe-43de-9f26-f0beb2a5afac for instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd on hv-cinder-85220 Aug 08 16:57:36.784539 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-e3c0261b-dcb1-4cb2-a376-93c3e1ece973 req-367d69a4-4c33-458e-b79b-2325722d3714 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069329 Aug 08 16:57:36.784539 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 355/717] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:36.960087 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-10c2120a-e673-4a30-b5d3-0445e1c72449 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:36.975125 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-10c2120a-e673-4a30-b5d3-0445e1c72449 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:36.978203 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-10c2120a-e673-4a30-b5d3-0445e1c72449 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:36.980922 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-10c2120a-e673-4a30-b5d3-0445e1c72449 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1752 microversion: 2.20 time: 0.291709 Aug 08 16:57:36.982021 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 363/718] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:36 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1752 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:57:37.049736 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7b683ee7-ad34-4060-a754-0093a9c2e48e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:37.050555 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7b683ee7-ad34-4060-a754-0093a9c2e48e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:37.058455 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b683ee7-ad34-4060-a754-0093a9c2e48e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:37.059074 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b683ee7-ad34-4060-a754-0093a9c2e48e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:37.059723 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b683ee7-ad34-4060-a754-0093a9c2e48e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:37.060969 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b683ee7-ad34-4060-a754-0093a9c2e48e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:37.061606 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b683ee7-ad34-4060-a754-0093a9c2e48e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:37.062108 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7b683ee7-ad34-4060-a754-0093a9c2e48e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:37.314654 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5e50264f-9e27-4e32-8b54-e3016a3187a1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:37.315989 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5e50264f-9e27-4e32-8b54-e3016a3187a1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:37.325812 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5e50264f-9e27-4e32-8b54-e3016a3187a1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:37.326639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5e50264f-9e27-4e32-8b54-e3016a3187a1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:37.327316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5e50264f-9e27-4e32-8b54-e3016a3187a1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:37.328199 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5e50264f-9e27-4e32-8b54-e3016a3187a1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:37.328636 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5e50264f-9e27-4e32-8b54-e3016a3187a1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:37.329199 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5e50264f-9e27-4e32-8b54-e3016a3187a1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:37.403308 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7b683ee7-ad34-4060-a754-0093a9c2e48e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:37.412524 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7b683ee7-ad34-4060-a754-0093a9c2e48e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.367924 Aug 08 16:57:37.413930 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 356/719] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:37 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:37.419204 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:37.419838 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:37.426534 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:37.427259 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:37.427696 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:37.428798 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:37.430094 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:37.430405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:37.468418 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:37.468959 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:37.469483 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:37.470023 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lazy-loading 'fault' on Instance uuid 00980f58-f4e7-4ca4-9f21-d8d665401320 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:57:37.577016 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683bed0160e54791a8e638523ac7e460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49844b73a63b4c338fc5109f70ba774e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:37.592912 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-5e50264f-9e27-4e32-8b54-e3016a3187a1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:37.595520 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2c38f4b1-aa59-4135-ab34-41427be05c97 tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 200 len: 1308 microversion: 2.1 time: 0.180202 Aug 08 16:57:37.596349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 357/720] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:37 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:37.606185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5e50264f-9e27-4e32-8b54-e3016a3187a1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1664 microversion: 2.1 time: 0.297607 Aug 08 16:57:37.607444 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 364/721] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:37 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1664 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:37.749347 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-667f0e3d-da5c-4d65-b30c-9d043d437aa9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:37.751386 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-667f0e3d-da5c-4d65-b30c-9d043d437aa9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:37.777856 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-667f0e3d-da5c-4d65-b30c-9d043d437aa9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:37.779221 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-667f0e3d-da5c-4d65-b30c-9d043d437aa9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:37.780692 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-667f0e3d-da5c-4d65-b30c-9d043d437aa9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:37.782056 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-667f0e3d-da5c-4d65-b30c-9d043d437aa9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:37.783043 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-667f0e3d-da5c-4d65-b30c-9d043d437aa9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:37.784178 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-667f0e3d-da5c-4d65-b30c-9d043d437aa9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:37.915522 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-7392f42e-4ee1-4241-82b4-cacdebaa1ca6 req-3584f7e5-4400-4834-b69e-e329e5cf0755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0affcec-8e4c-461a-ac29-5ac8d4fd92bd", "name": "network-vif-deleted", "tag": "412ef6d6-1ffe-43de-9f26-f0beb2a5afac"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:37.934526 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-7392f42e-4ee1-4241-82b4-cacdebaa1ca6 req-3584f7e5-4400-4834-b69e-e329e5cf0755 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:37.935435 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-7392f42e-4ee1-4241-82b4-cacdebaa1ca6 req-3584f7e5-4400-4834-b69e-e329e5cf0755 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:37.936115 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-7392f42e-4ee1-4241-82b4-cacdebaa1ca6 req-3584f7e5-4400-4834-b69e-e329e5cf0755 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:37.943658 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-667f0e3d-da5c-4d65-b30c-9d043d437aa9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:37.953863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-667f0e3d-da5c-4d65-b30c-9d043d437aa9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1612 microversion: 2.1 time: 0.214127 Aug 08 16:57:37.954634 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 358/722] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:37 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1612 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:37.965830 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-7392f42e-4ee1-4241-82b4-cacdebaa1ca6 req-3584f7e5-4400-4834-b69e-e329e5cf0755 service nova] Creating event network-vif-deleted:412ef6d6-1ffe-43de-9f26-f0beb2a5afac for instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd on hv-cinder-85220 Aug 08 16:57:37.975670 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-7392f42e-4ee1-4241-82b4-cacdebaa1ca6 req-3584f7e5-4400-4834-b69e-e329e5cf0755 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213168 Aug 08 16:57:37.978124 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 365/723] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:57:38.006003 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ccc7ccfe-b5d9-4179-be96-c6da6833b2df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:38.006545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ccc7ccfe-b5d9-4179-be96-c6da6833b2df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:38.013354 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ccc7ccfe-b5d9-4179-be96-c6da6833b2df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:38.013854 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ccc7ccfe-b5d9-4179-be96-c6da6833b2df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:38.014294 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ccc7ccfe-b5d9-4179-be96-c6da6833b2df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:38.015053 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ccc7ccfe-b5d9-4179-be96-c6da6833b2df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:38.015599 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ccc7ccfe-b5d9-4179-be96-c6da6833b2df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:38.016081 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ccc7ccfe-b5d9-4179-be96-c6da6833b2df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:38.198737 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ccc7ccfe-b5d9-4179-be96-c6da6833b2df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:38.212605 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ccc7ccfe-b5d9-4179-be96-c6da6833b2df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:38.216054 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ccc7ccfe-b5d9-4179-be96-c6da6833b2df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:38.217833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ccc7ccfe-b5d9-4179-be96-c6da6833b2df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.216120 Aug 08 16:57:38.218993 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 359/724] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:37 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:38.456190 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4b74e0c6-3336-4df4-98fe-4ec60e5b567c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:38.457209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4b74e0c6-3336-4df4-98fe-4ec60e5b567c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:38.471916 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4b74e0c6-3336-4df4-98fe-4ec60e5b567c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:38.475495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4b74e0c6-3336-4df4-98fe-4ec60e5b567c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:38.475495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4b74e0c6-3336-4df4-98fe-4ec60e5b567c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:38.475495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4b74e0c6-3336-4df4-98fe-4ec60e5b567c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:38.475495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4b74e0c6-3336-4df4-98fe-4ec60e5b567c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:38.476241 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4b74e0c6-3336-4df4-98fe-4ec60e5b567c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:38.637695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-05ad3858-ff69-421e-a325-ef636363620c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:38.639151 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-05ad3858-ff69-421e-a325-ef636363620c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] [instance: 00980f58-f4e7-4ca4-9f21-d8d665401320] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:38.649686 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-05ad3858-ff69-421e-a325-ef636363620c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:38.650174 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-05ad3858-ff69-421e-a325-ef636363620c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:38.650824 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-05ad3858-ff69-421e-a325-ef636363620c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:38.651725 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-05ad3858-ff69-421e-a325-ef636363620c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:38.652612 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-05ad3858-ff69-421e-a325-ef636363620c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:38.653053 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-05ad3858-ff69-421e-a325-ef636363620c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:38.680658 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-05ad3858-ff69-421e-a325-ef636363620c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] HTTP exception thrown: Instance 00980f58-f4e7-4ca4-9f21-d8d665401320 could not be found. Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-05ad3858-ff69-421e-a325-ef636363620c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Request method failure captured: Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 HTTP/1.1 Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T-y5nCNglxGdjnXaEGyBdv83qy5WhinjwEclBO4xA222LUyt7kxLHSjHikgR56mtK739bMALoK_6Z4wIVogaWN0enLuCNCOzrjptXCWxC-0L3_hcSGoaeYpqWaMekvFamKrq7MIbSKXmvMwmCBfUFk0RrTIRWaFj2uDDVoIe0hxTT4 Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 49844b73a63b4c338fc5109f70ba774e Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-VolumesSnapshotTestJSON-174063897 Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:57:38.682530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:57:38.684475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49844b73a63b4c338fc5109f70ba774e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49844b73a63b4c338fc5109f70ba774e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49844b73a63b4c338fc5109f70ba774e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49844b73a63b4c338fc5109f70ba774e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:57:38.684475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-VolumesSnapshotTestJSON-174063897 Aug 08 16:57:38.684475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 49844b73a63b4c338fc5109f70ba774e Aug 08 16:57:38.684475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-174063897 Aug 08 16:57:38.684475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-VolumesSnapshotTestJSON-174063897-project Aug 08 16:57:38.684475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:57:38.684475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:57:38.684475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: 683bed0160e54791a8e638523ac7e460 Aug 08 16:57:38.684475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-VolumesSnapshotTestJSON-174063897-project Aug 08 16:57:38.684475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:57:38.684475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 00980f58-f4e7-4ca4-9f21-d8d665401320 could not be found. Aug 08 16:57:38.684475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '00980f58-f4e7-4ca4-9f21-d8d665401320'} Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00980f58-f4e7-4ca4-9f21-d8d665401320 could not be found. Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:57:38.685358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00980f58-f4e7-4ca4-9f21-d8d665401320 could not be found. Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00980f58-f4e7-4ca4-9f21-d8d665401320 could not be found. Aug 08 16:57:38.688134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:38.689927 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4b74e0c6-3336-4df4-98fe-4ec60e5b567c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:38.691306 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-05ad3858-ff69-421e-a325-ef636363620c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] Returning 404 to user: Instance 00980f58-f4e7-4ca4-9f21-d8d665401320 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:57:38.692797 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-05ad3858-ff69-421e-a325-ef636363620c tempest-VolumesSnapshotTestJSON-174063897 tempest-VolumesSnapshotTestJSON-174063897-project] 10.222.0.13 "GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320" status: 404 len: 111 microversion: 2.1 time: 0.059472 Aug 08 16:57:38.693381 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 360/725] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:38 2022] GET /compute/v2.1/servers/00980f58-f4e7-4ca4-9f21-d8d665401320 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 16:57:38.699341 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9b65ea84-0b89-4e3b-9101-02558bb5c18a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:38.700682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9b65ea84-0b89-4e3b-9101-02558bb5c18a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:38.704600 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4b74e0c6-3336-4df4-98fe-4ec60e5b567c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.252894 Aug 08 16:57:38.712159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 366/726] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:38 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:38.716221 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9b65ea84-0b89-4e3b-9101-02558bb5c18a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:38.716809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9b65ea84-0b89-4e3b-9101-02558bb5c18a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:38.717326 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9b65ea84-0b89-4e3b-9101-02558bb5c18a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:38.718243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9b65ea84-0b89-4e3b-9101-02558bb5c18a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:38.718940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9b65ea84-0b89-4e3b-9101-02558bb5c18a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:38.719446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9b65ea84-0b89-4e3b-9101-02558bb5c18a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:38.996687 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:38.997765 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:39.008590 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:39.008590 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:39.009339 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:39.010777 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:39.011463 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:39.012020 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:39.051975 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9b65ea84-0b89-4e3b-9101-02558bb5c18a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:39.057503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:39.057987 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:39.058625 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:39.059237 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lazy-loading 'fault' on Instance uuid e0affcec-8e4c-461a-ac29-5ac8d4fd92bd {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:57:39.068640 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9b65ea84-0b89-4e3b-9101-02558bb5c18a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1668 microversion: 2.1 time: 0.373565 Aug 08 16:57:39.069520 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 361/727] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:38 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1668 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:39.119160 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:39.127575 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7587f529-6c34-4c31-880e-54b9024631ad tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 200 len: 1331 microversion: 2.1 time: 0.138759 Aug 08 16:57:39.128174 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 367/728] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:38 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 1331 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:39.265536 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ddcd916c-19c6-47d9-bef8-60cefa4c2884 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:39.270549 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ddcd916c-19c6-47d9-bef8-60cefa4c2884 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:39.283073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ddcd916c-19c6-47d9-bef8-60cefa4c2884 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:39.283581 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ddcd916c-19c6-47d9-bef8-60cefa4c2884 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:39.284029 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ddcd916c-19c6-47d9-bef8-60cefa4c2884 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:39.284751 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ddcd916c-19c6-47d9-bef8-60cefa4c2884 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:39.285634 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ddcd916c-19c6-47d9-bef8-60cefa4c2884 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:39.286077 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ddcd916c-19c6-47d9-bef8-60cefa4c2884 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:39.639544 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ddcd916c-19c6-47d9-bef8-60cefa4c2884 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:39.647869 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ddcd916c-19c6-47d9-bef8-60cefa4c2884 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:39.650802 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ddcd916c-19c6-47d9-bef8-60cefa4c2884 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:39.652734 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ddcd916c-19c6-47d9-bef8-60cefa4c2884 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.397439 Aug 08 16:57:39.653941 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 362/729] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:39 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:39.749842 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8b9c3928-eda5-4605-aaf5-62707123ba6f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:39.750928 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8b9c3928-eda5-4605-aaf5-62707123ba6f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:39.768179 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8b9c3928-eda5-4605-aaf5-62707123ba6f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:39.768990 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8b9c3928-eda5-4605-aaf5-62707123ba6f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:39.769790 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8b9c3928-eda5-4605-aaf5-62707123ba6f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:39.771119 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8b9c3928-eda5-4605-aaf5-62707123ba6f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:39.772226 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8b9c3928-eda5-4605-aaf5-62707123ba6f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:39.772826 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8b9c3928-eda5-4605-aaf5-62707123ba6f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:39.980503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8b9c3928-eda5-4605-aaf5-62707123ba6f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:39.989483 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-8b9c3928-eda5-4605-aaf5-62707123ba6f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.250749 Aug 08 16:57:39.990083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 368/730] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:39 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:40.153236 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6e2c4568-3c42-489b-be5c-08ac28dee9eb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:40.153935 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6e2c4568-3c42-489b-be5c-08ac28dee9eb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:40.162301 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e2c4568-3c42-489b-be5c-08ac28dee9eb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:40.163033 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e2c4568-3c42-489b-be5c-08ac28dee9eb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:40.164503 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e2c4568-3c42-489b-be5c-08ac28dee9eb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:40.165924 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e2c4568-3c42-489b-be5c-08ac28dee9eb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:40.166605 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e2c4568-3c42-489b-be5c-08ac28dee9eb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:40.167204 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e2c4568-3c42-489b-be5c-08ac28dee9eb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:40.185825 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-6e2c4568-3c42-489b-be5c-08ac28dee9eb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6e2c4568-3c42-489b-be5c-08ac28dee9eb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd HTTP/1.1 Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:57:40.187610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:57:40.190500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:57:40.190500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:57:40.190500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 16:57:40.190500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:57:40.190500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 16:57:40.190500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:57:40.190500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:57:40.190500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 16:57:40.190500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 16:57:40.190500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:57:40.190500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 16:57:40.190500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'e0affcec-8e4c-461a-ac29-5ac8d4fd92bd'} Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:57:40.192480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 16:57:40.195179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:57:40.196394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6e2c4568-3c42-489b-be5c-08ac28dee9eb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 404 to user: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:57:40.196394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-6e2c4568-3c42-489b-be5c-08ac28dee9eb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 404 len: 111 microversion: 2.1 time: 0.041780 Aug 08 16:57:40.197074 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 363/731] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:40 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 16:57:40.203356 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a1cd05ee-01c9-48d7-a91c-883115253f6e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '.version_select at 0x7f5016243040>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:40.349631 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a1cd05ee-01c9-48d7-a91c-883115253f6e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1286572764" status: 202 len: 0 microversion: 2.1 time: 0.149684 Aug 08 16:57:40.350862 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 369/732] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Aug 8 16:57:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1286572764 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:57:40.702326 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fa7e56a9-59f8-4582-8baf-41e32dad38f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:40.704613 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fa7e56a9-59f8-4582-8baf-41e32dad38f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:40.717454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa7e56a9-59f8-4582-8baf-41e32dad38f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:40.718219 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa7e56a9-59f8-4582-8baf-41e32dad38f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:40.718721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa7e56a9-59f8-4582-8baf-41e32dad38f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:40.719559 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa7e56a9-59f8-4582-8baf-41e32dad38f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:40.720062 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa7e56a9-59f8-4582-8baf-41e32dad38f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:40.720759 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa7e56a9-59f8-4582-8baf-41e32dad38f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:41.013462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8f7c111d-4e93-48d0-bbf6-cea3bf72541f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:41.014211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8f7c111d-4e93-48d0-bbf6-cea3bf72541f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:41.024414 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8f7c111d-4e93-48d0-bbf6-cea3bf72541f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:41.024943 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8f7c111d-4e93-48d0-bbf6-cea3bf72541f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:41.025395 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8f7c111d-4e93-48d0-bbf6-cea3bf72541f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:41.026128 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8f7c111d-4e93-48d0-bbf6-cea3bf72541f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:41.026655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8f7c111d-4e93-48d0-bbf6-cea3bf72541f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:41.027190 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8f7c111d-4e93-48d0-bbf6-cea3bf72541f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:41.047625 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:41.143126 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fa7e56a9-59f8-4582-8baf-41e32dad38f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:41.157963 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fa7e56a9-59f8-4582-8baf-41e32dad38f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:41.159632 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fa7e56a9-59f8-4582-8baf-41e32dad38f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:41.160963 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fa7e56a9-59f8-4582-8baf-41e32dad38f5 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.471452 Aug 08 16:57:41.161778 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 364/733] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:40 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:41.266400 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8f7c111d-4e93-48d0-bbf6-cea3bf72541f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:41.285653 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-8f7c111d-4e93-48d0-bbf6-cea3bf72541f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.276789 Aug 08 16:57:41.287264 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 370/734] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:41 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:41.756508 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9a6f997c-9cc5-49be-9d1e-227c657ab568 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Action: 'create', calling method: .version_select at 0x7f5015f040d0>, body: {"keypair": {"name": "tempest-keypair-838946971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMG01jWQbwbxkobW/SeDJSx5ckFpgEgptTvHroJufNSayQAauglE1C9sIo+kj/eeJOaUV54B0PmUBkMV4Ece2IffkgolCRiWdnEAZO7HzMevl+k2TPMTZcnGqjhzo5/zA=="}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:41.784967 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-9a6f997c-9cc5-49be-9d1e-227c657ab568 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for project b2063a114c1942cab80ae4b708be9ab2. Resources: {'key_pairs'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:57:41.790632 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-9a6f997c-9cc5-49be-9d1e-227c657ab568 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for user fdb16e7edbe143e9b96325842896f04e and project b2063a114c1942cab80ae4b708be9ab2. Resources: {'key_pairs'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:57:41.916143 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9a6f997c-9cc5-49be-9d1e-227c657ab568 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.167255 Aug 08 16:57:41.917319 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 365/735] 10.222.0.13 () {60 vars in 1159 bytes} [Mon Aug 8 16:57:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:57:42.200514 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e2569635-8ee5-448d-9396-8b07ff213f77 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:42.201578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e2569635-8ee5-448d-9396-8b07ff213f77 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:42.211771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e2569635-8ee5-448d-9396-8b07ff213f77 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:42.212955 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e2569635-8ee5-448d-9396-8b07ff213f77 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:42.213597 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e2569635-8ee5-448d-9396-8b07ff213f77 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:42.214753 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e2569635-8ee5-448d-9396-8b07ff213f77 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:42.215527 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e2569635-8ee5-448d-9396-8b07ff213f77 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:42.216129 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e2569635-8ee5-448d-9396-8b07ff213f77 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:42.339950 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a9d36dcb-d018-40cc-88f5-463ab4330b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:42.344758 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a9d36dcb-d018-40cc-88f5-463ab4330b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:42.374626 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a9d36dcb-d018-40cc-88f5-463ab4330b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:42.376068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a9d36dcb-d018-40cc-88f5-463ab4330b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:42.377223 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a9d36dcb-d018-40cc-88f5-463ab4330b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:42.378772 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a9d36dcb-d018-40cc-88f5-463ab4330b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:42.380015 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a9d36dcb-d018-40cc-88f5-463ab4330b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:42.381132 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a9d36dcb-d018-40cc-88f5-463ab4330b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:42.597932 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e2569635-8ee5-448d-9396-8b07ff213f77 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:42.614944 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e2569635-8ee5-448d-9396-8b07ff213f77 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:42.618784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e2569635-8ee5-448d-9396-8b07ff213f77 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:42.621545 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e2569635-8ee5-448d-9396-8b07ff213f77 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.425111 Aug 08 16:57:42.622899 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 371/736] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:42 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:57:42.655552 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a9d36dcb-d018-40cc-88f5-463ab4330b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:42.665763 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a9d36dcb-d018-40cc-88f5-463ab4330b68 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.333707 Aug 08 16:57:42.666365 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 366/737] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:42 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:43.665557 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-67ca82c5-8da6-4c65-9a8a-02a1696e5b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:43.677651 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-67ca82c5-8da6-4c65-9a8a-02a1696e5b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:43.677651 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67ca82c5-8da6-4c65-9a8a-02a1696e5b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:43.677651 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67ca82c5-8da6-4c65-9a8a-02a1696e5b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:43.677651 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67ca82c5-8da6-4c65-9a8a-02a1696e5b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:43.679063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67ca82c5-8da6-4c65-9a8a-02a1696e5b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:43.679063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67ca82c5-8da6-4c65-9a8a-02a1696e5b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:43.679063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67ca82c5-8da6-4c65-9a8a-02a1696e5b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:43.715966 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2f080e60-07b2-4b05-a778-246d1703c474 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:43.717106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2f080e60-07b2-4b05-a778-246d1703c474 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:43.725015 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f080e60-07b2-4b05-a778-246d1703c474 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:43.725516 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f080e60-07b2-4b05-a778-246d1703c474 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:43.726064 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f080e60-07b2-4b05-a778-246d1703c474 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:43.727616 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f080e60-07b2-4b05-a778-246d1703c474 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:43.727616 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f080e60-07b2-4b05-a778-246d1703c474 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:43.728235 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f080e60-07b2-4b05-a778-246d1703c474 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:43.955567 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-67ca82c5-8da6-4c65-9a8a-02a1696e5b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:43.972163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-67ca82c5-8da6-4c65-9a8a-02a1696e5b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:43.978233 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-67ca82c5-8da6-4c65-9a8a-02a1696e5b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:43.983117 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-67ca82c5-8da6-4c65-9a8a-02a1696e5b69 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.325733 Aug 08 16:57:43.984457 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 372/738] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:43 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:57:44.005354 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2f080e60-07b2-4b05-a778-246d1703c474 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:44.014527 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2f080e60-07b2-4b05-a778-246d1703c474 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.321748 Aug 08 16:57:44.015171 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 367/739] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:43 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:44.970905 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f332e0f1-2212-4bc5-a80e-0a496ebdf0eb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:44.975035 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f332e0f1-2212-4bc5-a80e-0a496ebdf0eb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:44.990016 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f332e0f1-2212-4bc5-a80e-0a496ebdf0eb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:44.991287 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f332e0f1-2212-4bc5-a80e-0a496ebdf0eb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:44.992722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f332e0f1-2212-4bc5-a80e-0a496ebdf0eb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:44.994050 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f332e0f1-2212-4bc5-a80e-0a496ebdf0eb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:44.995218 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f332e0f1-2212-4bc5-a80e-0a496ebdf0eb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:44.995934 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f332e0f1-2212-4bc5-a80e-0a496ebdf0eb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:45.016448 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-99967829-fe8a-4e41-a7d2-62fa8753c9b9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:45.021024 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-99967829-fe8a-4e41-a7d2-62fa8753c9b9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:45.038245 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-99967829-fe8a-4e41-a7d2-62fa8753c9b9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:45.039251 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-99967829-fe8a-4e41-a7d2-62fa8753c9b9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:45.040116 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-99967829-fe8a-4e41-a7d2-62fa8753c9b9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:45.042052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-99967829-fe8a-4e41-a7d2-62fa8753c9b9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:45.042930 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-99967829-fe8a-4e41-a7d2-62fa8753c9b9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:45.058469 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-99967829-fe8a-4e41-a7d2-62fa8753c9b9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:45.307776 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f332e0f1-2212-4bc5-a80e-0a496ebdf0eb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "POST /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/action" status: 202 len: 0 microversion: 2.1 time: 0.343250 Aug 08 16:57:45.308934 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 373/740] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 16:57:44 2022] POST /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:57:45.315172 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-881da3d2-f15a-4418-90b3-241818d3894e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:45.316393 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-881da3d2-f15a-4418-90b3-241818d3894e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:45.324697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-881da3d2-f15a-4418-90b3-241818d3894e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:45.325292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-881da3d2-f15a-4418-90b3-241818d3894e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:45.325972 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-881da3d2-f15a-4418-90b3-241818d3894e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:45.326756 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-881da3d2-f15a-4418-90b3-241818d3894e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:45.327229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-881da3d2-f15a-4418-90b3-241818d3894e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:45.327662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-881da3d2-f15a-4418-90b3-241818d3894e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:45.475242 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-99967829-fe8a-4e41-a7d2-62fa8753c9b9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:45.514544 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-99967829-fe8a-4e41-a7d2-62fa8753c9b9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:45.518392 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-99967829-fe8a-4e41-a7d2-62fa8753c9b9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:45.521305 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-99967829-fe8a-4e41-a7d2-62fa8753c9b9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.515678 Aug 08 16:57:45.523613 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 368/741] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:45 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:45.533547 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-77473a06-0987-4e6d-8b44-be01c4bf3558 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:45.535571 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-77473a06-0987-4e6d-8b44-be01c4bf3558 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:45.564238 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-77473a06-0987-4e6d-8b44-be01c4bf3558 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:45.565964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-77473a06-0987-4e6d-8b44-be01c4bf3558 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:45.567458 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-77473a06-0987-4e6d-8b44-be01c4bf3558 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:45.572732 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-77473a06-0987-4e6d-8b44-be01c4bf3558 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:45.575556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-77473a06-0987-4e6d-8b44-be01c4bf3558 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:45.578441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-77473a06-0987-4e6d-8b44-be01c4bf3558 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:45.590752 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-881da3d2-f15a-4418-90b3-241818d3894e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:45.621833 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-881da3d2-f15a-4418-90b3-241818d3894e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.304674 Aug 08 16:57:45.622959 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 374/742] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:45 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:45.929776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-77473a06-0987-4e6d-8b44-be01c4bf3558 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:45.952724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-77473a06-0987-4e6d-8b44-be01c4bf3558 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1750 microversion: 2.1 time: 0.424564 Aug 08 16:57:45.954603 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 369/743] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:45 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1750 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:46.083145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1919384933", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13e31057-f543-4337-919e-432a457bba76"}], "security_groups": [{"name": "tempest-securitygroup--1045740881"}], "key_name": "tempest-keypair-838946971", "user_data": "}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:57:46.262144 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.network.neutron [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] validate_networks() for [('13e31057-f543-4337-919e-432a457bba76', None, None, None, None, None)] {{(pid=130236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:57:46.566239 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-575a12ea-c1d7-4b7d-a91d-91a0d0bb1cc6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:46.567578 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-575a12ea-c1d7-4b7d-a91d-91a0d0bb1cc6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:46.581458 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-575a12ea-c1d7-4b7d-a91d-91a0d0bb1cc6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:46.582377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-575a12ea-c1d7-4b7d-a91d-91a0d0bb1cc6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:46.583170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-575a12ea-c1d7-4b7d-a91d-91a0d0bb1cc6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:46.584198 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-575a12ea-c1d7-4b7d-a91d-91a0d0bb1cc6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:46.584892 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-575a12ea-c1d7-4b7d-a91d-91a0d0bb1cc6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:46.585587 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-575a12ea-c1d7-4b7d-a91d-91a0d0bb1cc6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:46.991968 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-575a12ea-c1d7-4b7d-a91d-91a0d0bb1cc6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:47.002963 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-575a12ea-c1d7-4b7d-a91d-91a0d0bb1cc6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:47.005321 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-575a12ea-c1d7-4b7d-a91d-91a0d0bb1cc6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:47.007022 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-575a12ea-c1d7-4b7d-a91d-91a0d0bb1cc6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.445696 Aug 08 16:57:47.032834 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 370/744] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:46 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:47.032834 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8d576375-1bc9-4697-a3a6-4c3a803fa301 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:47.032834 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8d576375-1bc9-4697-a3a6-4c3a803fa301 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:47.069433 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d576375-1bc9-4697-a3a6-4c3a803fa301 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:47.078026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d576375-1bc9-4697-a3a6-4c3a803fa301 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:47.087590 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d576375-1bc9-4697-a3a6-4c3a803fa301 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:47.089116 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d576375-1bc9-4697-a3a6-4c3a803fa301 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:47.089994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d576375-1bc9-4697-a3a6-4c3a803fa301 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:47.091166 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d576375-1bc9-4697-a3a6-4c3a803fa301 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:47.244737 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Flavor limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:57:47.245564 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Image limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:57:47.246697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Flavor pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:57:47.247849 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Image pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:57:47.248825 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:57:47.268994 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:47.270183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:47.272068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:47.275313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:47.277111 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:47.278592 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:47.315625 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for project b2063a114c1942cab80ae4b708be9ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:57:47.340487 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for user fdb16e7edbe143e9b96325842896f04e and project b2063a114c1942cab80ae4b708be9ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:57:47.350396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Going to run 1 instances... {{(pid=130236) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:57:47.353488 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:57:47.369200 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8d576375-1bc9-4697-a3a6-4c3a803fa301 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:47.392796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8d576375-1bc9-4697-a3a6-4c3a803fa301 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.376468 Aug 08 16:57:47.394721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 371/745] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:47 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:47.406429 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1023d530-234b-43f8-9ff6-6ea6d35fc4ea tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:47.407736 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1023d530-234b-43f8-9ff6-6ea6d35fc4ea tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:47.421488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1023d530-234b-43f8-9ff6-6ea6d35fc4ea tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:47.426833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1023d530-234b-43f8-9ff6-6ea6d35fc4ea tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:47.426833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1023d530-234b-43f8-9ff6-6ea6d35fc4ea tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:47.426833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1023d530-234b-43f8-9ff6-6ea6d35fc4ea tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:47.426833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1023d530-234b-43f8-9ff6-6ea6d35fc4ea tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:47.427874 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1023d530-234b-43f8-9ff6-6ea6d35fc4ea tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:47.536126 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b0f03c51-cabe-487b-a50e-9744bcbee6df tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.457091 Aug 08 16:57:47.537265 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 375/746] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:57:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 16:57:47.561513 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-63b4b50b-c878-4c8c-b68c-0d5ae15dcd1b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:47.563059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-63b4b50b-c878-4c8c-b68c-0d5ae15dcd1b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:47.675992 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-63b4b50b-c878-4c8c-b68c-0d5ae15dcd1b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:47.687629 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-63b4b50b-c878-4c8c-b68c-0d5ae15dcd1b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1241 microversion: 2.1 time: 0.131758 Aug 08 16:57:47.691337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 376/747] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:47 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1241 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:47.811899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1023d530-234b-43f8-9ff6-6ea6d35fc4ea tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:47.826105 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1023d530-234b-43f8-9ff6-6ea6d35fc4ea tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1750 microversion: 2.1 time: 0.429659 Aug 08 16:57:47.827568 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 372/748] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:47 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1750 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:48.047820 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0dcf9014-2cc0-4f77-9892-b7222a0f8ab1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:48.048910 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0dcf9014-2cc0-4f77-9892-b7222a0f8ab1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:48.063532 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0dcf9014-2cc0-4f77-9892-b7222a0f8ab1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:48.064058 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0dcf9014-2cc0-4f77-9892-b7222a0f8ab1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:48.065760 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0dcf9014-2cc0-4f77-9892-b7222a0f8ab1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:48.066836 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0dcf9014-2cc0-4f77-9892-b7222a0f8ab1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:48.070181 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0dcf9014-2cc0-4f77-9892-b7222a0f8ab1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:48.070181 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0dcf9014-2cc0-4f77-9892-b7222a0f8ab1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:48.278878 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0dcf9014-2cc0-4f77-9892-b7222a0f8ab1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:48.291024 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0dcf9014-2cc0-4f77-9892-b7222a0f8ab1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:48.294078 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0dcf9014-2cc0-4f77-9892-b7222a0f8ab1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:48.304977 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0dcf9014-2cc0-4f77-9892-b7222a0f8ab1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.266379 Aug 08 16:57:48.312434 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 377/749] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:48 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:48.420659 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d153179e-0b24-4f16-98c7-4f00f18e41e3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:48.422165 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d153179e-0b24-4f16-98c7-4f00f18e41e3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:48.443292 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d153179e-0b24-4f16-98c7-4f00f18e41e3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:48.443820 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d153179e-0b24-4f16-98c7-4f00f18e41e3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:48.444295 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d153179e-0b24-4f16-98c7-4f00f18e41e3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:48.445736 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d153179e-0b24-4f16-98c7-4f00f18e41e3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:48.446345 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d153179e-0b24-4f16-98c7-4f00f18e41e3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:48.446820 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d153179e-0b24-4f16-98c7-4f00f18e41e3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:48.450069 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=100 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:48.708670 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d153179e-0b24-4f16-98c7-4f00f18e41e3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:48.731594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d153179e-0b24-4f16-98c7-4f00f18e41e3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.319235 Aug 08 16:57:48.743179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 373/750] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:48 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:48.743502 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-19688357-b70e-4f14-9830-5ad320da16e6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:48.743502 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-19688357-b70e-4f14-9830-5ad320da16e6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:48.823855 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-19688357-b70e-4f14-9830-5ad320da16e6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:48.845572 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-19688357-b70e-4f14-9830-5ad320da16e6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1241 microversion: 2.1 time: 0.121460 Aug 08 16:57:48.846584 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 378/751] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:48 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:48.872480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1843d473-3133-48d0-ad4a-915c333275d3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:48.872480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1843d473-3133-48d0-ad4a-915c333275d3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:48.883236 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1843d473-3133-48d0-ad4a-915c333275d3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:48.884806 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1843d473-3133-48d0-ad4a-915c333275d3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:48.886641 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1843d473-3133-48d0-ad4a-915c333275d3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:48.888346 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1843d473-3133-48d0-ad4a-915c333275d3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:48.889280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1843d473-3133-48d0-ad4a-915c333275d3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:48.890234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1843d473-3133-48d0-ad4a-915c333275d3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:49.106286 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1843d473-3133-48d0-ad4a-915c333275d3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:49.115225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1843d473-3133-48d0-ad4a-915c333275d3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1750 microversion: 2.1 time: 0.258126 Aug 08 16:57:49.115828 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 374/752] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:48 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1750 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:49.352648 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a554d9b8-336a-4204-b5e2-8450625434f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:49.353570 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a554d9b8-336a-4204-b5e2-8450625434f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:49.360527 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a554d9b8-336a-4204-b5e2-8450625434f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:49.361024 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a554d9b8-336a-4204-b5e2-8450625434f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:49.361670 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a554d9b8-336a-4204-b5e2-8450625434f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:49.362211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a554d9b8-336a-4204-b5e2-8450625434f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:49.362708 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a554d9b8-336a-4204-b5e2-8450625434f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:49.363382 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a554d9b8-336a-4204-b5e2-8450625434f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:49.558428 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a554d9b8-336a-4204-b5e2-8450625434f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:49.575747 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a554d9b8-336a-4204-b5e2-8450625434f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:49.580089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a554d9b8-336a-4204-b5e2-8450625434f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:49.583216 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a554d9b8-336a-4204-b5e2-8450625434f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.234655 Aug 08 16:57:49.585789 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 379/753] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:49 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:57:49.759910 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9059048a-24e5-4208-95b3-df73f44484f2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:49.760998 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9059048a-24e5-4208-95b3-df73f44484f2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:49.768567 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9059048a-24e5-4208-95b3-df73f44484f2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:49.769064 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9059048a-24e5-4208-95b3-df73f44484f2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:49.769506 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9059048a-24e5-4208-95b3-df73f44484f2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:49.770322 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9059048a-24e5-4208-95b3-df73f44484f2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:49.770683 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9059048a-24e5-4208-95b3-df73f44484f2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:49.771110 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9059048a-24e5-4208-95b3-df73f44484f2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:49.900767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-69f1c438-1f61-4210-8d5b-7ee2b29bcdb9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:49.904049 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-69f1c438-1f61-4210-8d5b-7ee2b29bcdb9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:49.922923 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-69f1c438-1f61-4210-8d5b-7ee2b29bcdb9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:49.923839 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-69f1c438-1f61-4210-8d5b-7ee2b29bcdb9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:49.924434 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-69f1c438-1f61-4210-8d5b-7ee2b29bcdb9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:49.925656 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-69f1c438-1f61-4210-8d5b-7ee2b29bcdb9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:49.926682 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-69f1c438-1f61-4210-8d5b-7ee2b29bcdb9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:49.927512 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-69f1c438-1f61-4210-8d5b-7ee2b29bcdb9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:50.055527 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9059048a-24e5-4208-95b3-df73f44484f2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:50.056409 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-69f1c438-1f61-4210-8d5b-7ee2b29bcdb9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:50.065444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9059048a-24e5-4208-95b3-df73f44484f2 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.312291 Aug 08 16:57:50.080555 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-69f1c438-1f61-4210-8d5b-7ee2b29bcdb9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1245 microversion: 2.1 time: 0.186296 Aug 08 16:57:50.089472 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 375/754] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:49 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:50.098775 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 380/755] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:49 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1245 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:50.138598 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fdacb2b9-81c3-4304-a807-9f077200818c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:50.139326 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fdacb2b9-81c3-4304-a807-9f077200818c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:50.145955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fdacb2b9-81c3-4304-a807-9f077200818c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:50.146451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fdacb2b9-81c3-4304-a807-9f077200818c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:50.147093 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fdacb2b9-81c3-4304-a807-9f077200818c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:50.147882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fdacb2b9-81c3-4304-a807-9f077200818c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:50.148343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fdacb2b9-81c3-4304-a807-9f077200818c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:50.148830 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fdacb2b9-81c3-4304-a807-9f077200818c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:50.412274 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fdacb2b9-81c3-4304-a807-9f077200818c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:50.447391 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fdacb2b9-81c3-4304-a807-9f077200818c tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1750 microversion: 2.1 time: 0.312020 Aug 08 16:57:50.447391 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 376/756] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:50 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1750 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:50.610416 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-44dd5fd5-0325-48af-af1f-66c6ac94fc44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:50.611084 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-44dd5fd5-0325-48af-af1f-66c6ac94fc44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:50.622264 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-44dd5fd5-0325-48af-af1f-66c6ac94fc44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:50.622833 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-44dd5fd5-0325-48af-af1f-66c6ac94fc44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:50.623279 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-44dd5fd5-0325-48af-af1f-66c6ac94fc44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:50.624022 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-44dd5fd5-0325-48af-af1f-66c6ac94fc44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:50.624488 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-44dd5fd5-0325-48af-af1f-66c6ac94fc44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:50.624915 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-44dd5fd5-0325-48af-af1f-66c6ac94fc44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:50.841961 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-44dd5fd5-0325-48af-af1f-66c6ac94fc44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:50.868589 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-44dd5fd5-0325-48af-af1f-66c6ac94fc44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:50.878513 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-44dd5fd5-0325-48af-af1f-66c6ac94fc44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:50.880259 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-44dd5fd5-0325-48af-af1f-66c6ac94fc44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.273952 Aug 08 16:57:50.883471 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 381/757] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:50 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:51.096402 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a8c080de-6428-4920-a29c-7efe651f4e37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:51.097348 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a8c080de-6428-4920-a29c-7efe651f4e37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:51.106393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a8c080de-6428-4920-a29c-7efe651f4e37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:51.109939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a8c080de-6428-4920-a29c-7efe651f4e37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:51.109939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a8c080de-6428-4920-a29c-7efe651f4e37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:51.109939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a8c080de-6428-4920-a29c-7efe651f4e37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:51.110725 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a8c080de-6428-4920-a29c-7efe651f4e37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:51.111232 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a8c080de-6428-4920-a29c-7efe651f4e37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:51.114107 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4be99382-f78d-452b-882d-e8fc5b4e7302 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:51.115845 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4be99382-f78d-452b-882d-e8fc5b4e7302 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:51.139643 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4be99382-f78d-452b-882d-e8fc5b4e7302 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:51.140477 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4be99382-f78d-452b-882d-e8fc5b4e7302 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:51.145487 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4be99382-f78d-452b-882d-e8fc5b4e7302 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:51.146560 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4be99382-f78d-452b-882d-e8fc5b4e7302 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:51.147091 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4be99382-f78d-452b-882d-e8fc5b4e7302 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:51.148270 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4be99382-f78d-452b-882d-e8fc5b4e7302 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:51.238961 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4be99382-f78d-452b-882d-e8fc5b4e7302 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:51.258843 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4be99382-f78d-452b-882d-e8fc5b4e7302 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1245 microversion: 2.1 time: 0.151973 Aug 08 16:57:51.274473 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 382/758] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:51 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1245 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:51.357344 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a8c080de-6428-4920-a29c-7efe651f4e37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:51.371980 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a8c080de-6428-4920-a29c-7efe651f4e37 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.279410 Aug 08 16:57:51.372976 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 377/759] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:51 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:51.489552 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6ee1d9a0-1aab-43b5-b025-a9e573980da3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:51.490159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6ee1d9a0-1aab-43b5-b025-a9e573980da3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:51.497184 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6ee1d9a0-1aab-43b5-b025-a9e573980da3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:51.497767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6ee1d9a0-1aab-43b5-b025-a9e573980da3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:51.498436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6ee1d9a0-1aab-43b5-b025-a9e573980da3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:51.499382 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6ee1d9a0-1aab-43b5-b025-a9e573980da3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:51.499938 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6ee1d9a0-1aab-43b5-b025-a9e573980da3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:51.500476 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6ee1d9a0-1aab-43b5-b025-a9e573980da3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:51.694207 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6ee1d9a0-1aab-43b5-b025-a9e573980da3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:51.706226 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6ee1d9a0-1aab-43b5-b025-a9e573980da3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1750 microversion: 2.1 time: 0.220297 Aug 08 16:57:51.707574 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 383/760] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:51 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1750 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:51.918141 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f0b32248-1a90-42f1-bb47-976bcd6c5d03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:51.923548 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f0b32248-1a90-42f1-bb47-976bcd6c5d03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:51.929913 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=4 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:51.936714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f0b32248-1a90-42f1-bb47-976bcd6c5d03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:51.938128 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f0b32248-1a90-42f1-bb47-976bcd6c5d03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:51.938726 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f0b32248-1a90-42f1-bb47-976bcd6c5d03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:51.939525 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f0b32248-1a90-42f1-bb47-976bcd6c5d03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:51.940124 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f0b32248-1a90-42f1-bb47-976bcd6c5d03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:51.940695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f0b32248-1a90-42f1-bb47-976bcd6c5d03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:52.133349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f0b32248-1a90-42f1-bb47-976bcd6c5d03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:52.146866 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f0b32248-1a90-42f1-bb47-976bcd6c5d03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:52.149090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f0b32248-1a90-42f1-bb47-976bcd6c5d03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:52.150449 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f0b32248-1a90-42f1-bb47-976bcd6c5d03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.239787 Aug 08 16:57:52.151118 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 378/761] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:51 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:52.282181 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d1d856c8-a904-491a-979b-f2821fee0654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:52.282842 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d1d856c8-a904-491a-979b-f2821fee0654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:52.292460 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d1d856c8-a904-491a-979b-f2821fee0654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:52.293080 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d1d856c8-a904-491a-979b-f2821fee0654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:52.293608 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d1d856c8-a904-491a-979b-f2821fee0654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:52.294382 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d1d856c8-a904-491a-979b-f2821fee0654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:52.294917 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d1d856c8-a904-491a-979b-f2821fee0654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:52.295383 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d1d856c8-a904-491a-979b-f2821fee0654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:52.382828 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d1d856c8-a904-491a-979b-f2821fee0654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:52.391104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d1d856c8-a904-491a-979b-f2821fee0654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1245 microversion: 2.1 time: 0.113355 Aug 08 16:57:52.391956 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 384/762] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:52 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:52.402070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8e596049-9752-4749-8f53-61b3578e3f24 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:52.408605 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8e596049-9752-4749-8f53-61b3578e3f24 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:52.415415 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e596049-9752-4749-8f53-61b3578e3f24 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:52.416277 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e596049-9752-4749-8f53-61b3578e3f24 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:52.417054 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e596049-9752-4749-8f53-61b3578e3f24 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:52.418319 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e596049-9752-4749-8f53-61b3578e3f24 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:52.419185 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e596049-9752-4749-8f53-61b3578e3f24 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:52.419949 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e596049-9752-4749-8f53-61b3578e3f24 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:52.578802 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8e596049-9752-4749-8f53-61b3578e3f24 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:52.588517 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8e596049-9752-4749-8f53-61b3578e3f24 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.194940 Aug 08 16:57:52.589113 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 379/763] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:52 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:52.731966 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-27b2ada0-9263-456f-af89-32e7df3aeab3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:52.732631 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-27b2ada0-9263-456f-af89-32e7df3aeab3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:52.739185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27b2ada0-9263-456f-af89-32e7df3aeab3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:52.739680 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27b2ada0-9263-456f-af89-32e7df3aeab3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:52.740121 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27b2ada0-9263-456f-af89-32e7df3aeab3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:52.740847 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27b2ada0-9263-456f-af89-32e7df3aeab3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:52.742093 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27b2ada0-9263-456f-af89-32e7df3aeab3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:52.742305 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27b2ada0-9263-456f-af89-32e7df3aeab3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:52.924654 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-27b2ada0-9263-456f-af89-32e7df3aeab3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:52.937893 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-27b2ada0-9263-456f-af89-32e7df3aeab3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1750 microversion: 2.1 time: 0.209989 Aug 08 16:57:52.938680 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 385/764] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:52 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1750 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:53.175505 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7153c271-63a7-45c5-a602-d1a02149b132 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:53.177301 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7153c271-63a7-45c5-a602-d1a02149b132 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:53.190976 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7153c271-63a7-45c5-a602-d1a02149b132 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:53.192104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7153c271-63a7-45c5-a602-d1a02149b132 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:53.192901 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7153c271-63a7-45c5-a602-d1a02149b132 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:53.194169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7153c271-63a7-45c5-a602-d1a02149b132 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:53.195525 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7153c271-63a7-45c5-a602-d1a02149b132 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:53.196331 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7153c271-63a7-45c5-a602-d1a02149b132 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:53.416747 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-70f7622e-f8db-40f3-a90d-057eb99d2dbc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:53.417563 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-70f7622e-f8db-40f3-a90d-057eb99d2dbc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:53.425649 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70f7622e-f8db-40f3-a90d-057eb99d2dbc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:53.426346 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70f7622e-f8db-40f3-a90d-057eb99d2dbc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:53.426954 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70f7622e-f8db-40f3-a90d-057eb99d2dbc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:53.427893 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70f7622e-f8db-40f3-a90d-057eb99d2dbc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:53.428456 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70f7622e-f8db-40f3-a90d-057eb99d2dbc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:53.429210 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70f7622e-f8db-40f3-a90d-057eb99d2dbc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:53.515572 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7153c271-63a7-45c5-a602-d1a02149b132 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:53.532030 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7153c271-63a7-45c5-a602-d1a02149b132 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:53.535200 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7153c271-63a7-45c5-a602-d1a02149b132 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:53.537207 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7153c271-63a7-45c5-a602-d1a02149b132 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.365731 Aug 08 16:57:53.537886 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 380/765] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:53 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:53.540359 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-70f7622e-f8db-40f3-a90d-057eb99d2dbc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:53.549266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-70f7622e-f8db-40f3-a90d-057eb99d2dbc tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1245 microversion: 2.1 time: 0.137475 Aug 08 16:57:53.550064 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 386/766] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:53 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1245 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:53.611769 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7751a100-ac73-40fd-9790-d6258d6329d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:53.612475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7751a100-ac73-40fd-9790-d6258d6329d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:53.620089 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7751a100-ac73-40fd-9790-d6258d6329d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:53.620571 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7751a100-ac73-40fd-9790-d6258d6329d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:53.621006 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7751a100-ac73-40fd-9790-d6258d6329d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:53.621704 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7751a100-ac73-40fd-9790-d6258d6329d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:53.622154 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7751a100-ac73-40fd-9790-d6258d6329d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:53.622591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7751a100-ac73-40fd-9790-d6258d6329d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:53.772902 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7751a100-ac73-40fd-9790-d6258d6329d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:53.782244 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7751a100-ac73-40fd-9790-d6258d6329d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.174402 Aug 08 16:57:53.782931 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 381/767] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:53 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:53.960918 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7953b26d-9ccf-4a02-b082-5f86a945ce94 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:53.961682 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7953b26d-9ccf-4a02-b082-5f86a945ce94 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:53.968265 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7953b26d-9ccf-4a02-b082-5f86a945ce94 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:53.968747 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7953b26d-9ccf-4a02-b082-5f86a945ce94 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:53.969195 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7953b26d-9ccf-4a02-b082-5f86a945ce94 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:53.969940 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7953b26d-9ccf-4a02-b082-5f86a945ce94 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:53.970388 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7953b26d-9ccf-4a02-b082-5f86a945ce94 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:53.970838 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7953b26d-9ccf-4a02-b082-5f86a945ce94 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:54.151902 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7953b26d-9ccf-4a02-b082-5f86a945ce94 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:54.160739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7953b26d-9ccf-4a02-b082-5f86a945ce94 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1750 microversion: 2.1 time: 0.204108 Aug 08 16:57:54.161336 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 387/768] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:53 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1750 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:54.563374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-25efb39d-99c0-489d-b155-e40323b90d2f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:54.564261 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-25efb39d-99c0-489d-b155-e40323b90d2f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:54.573725 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-25efb39d-99c0-489d-b155-e40323b90d2f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:54.574309 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-25efb39d-99c0-489d-b155-e40323b90d2f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:54.574941 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-25efb39d-99c0-489d-b155-e40323b90d2f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:54.575154 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-871f38bd-d79f-4d1a-8711-5130deda7820 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:54.575799 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-25efb39d-99c0-489d-b155-e40323b90d2f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:54.576053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-871f38bd-d79f-4d1a-8711-5130deda7820 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:54.576469 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-25efb39d-99c0-489d-b155-e40323b90d2f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:54.576968 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-25efb39d-99c0-489d-b155-e40323b90d2f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:54.584972 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-871f38bd-d79f-4d1a-8711-5130deda7820 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:54.585633 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-871f38bd-d79f-4d1a-8711-5130deda7820 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:54.586185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-871f38bd-d79f-4d1a-8711-5130deda7820 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:54.587087 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-871f38bd-d79f-4d1a-8711-5130deda7820 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:54.587656 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-871f38bd-d79f-4d1a-8711-5130deda7820 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:54.588189 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-871f38bd-d79f-4d1a-8711-5130deda7820 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:54.670555 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-871f38bd-d79f-4d1a-8711-5130deda7820 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:54.674453 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:54.687641 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-871f38bd-d79f-4d1a-8711-5130deda7820 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1245 microversion: 2.1 time: 0.117566 Aug 08 16:57:54.689070 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 388/769] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:54 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:54.780590 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-25efb39d-99c0-489d-b155-e40323b90d2f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:54.791084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-25efb39d-99c0-489d-b155-e40323b90d2f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:54.792694 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-25efb39d-99c0-489d-b155-e40323b90d2f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:54.793900 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-25efb39d-99c0-489d-b155-e40323b90d2f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.234730 Aug 08 16:57:54.794541 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 382/770] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:54 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:54.806143 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ad92cd5f-2653-4c9f-8fbd-e9ff116d38e7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:54.807133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ad92cd5f-2653-4c9f-8fbd-e9ff116d38e7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:54.815116 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ad92cd5f-2653-4c9f-8fbd-e9ff116d38e7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:54.815555 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ad92cd5f-2653-4c9f-8fbd-e9ff116d38e7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:54.816113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ad92cd5f-2653-4c9f-8fbd-e9ff116d38e7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:54.817084 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ad92cd5f-2653-4c9f-8fbd-e9ff116d38e7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:54.817613 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ad92cd5f-2653-4c9f-8fbd-e9ff116d38e7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:54.818099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ad92cd5f-2653-4c9f-8fbd-e9ff116d38e7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:54.977869 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ad92cd5f-2653-4c9f-8fbd-e9ff116d38e7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:54.986846 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ad92cd5f-2653-4c9f-8fbd-e9ff116d38e7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.185338 Aug 08 16:57:54.987461 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 389/771] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:54 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:57:55.184199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4ea2ef63-b8ff-41df-bfc6-c96f7677fdd8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:55.184830 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4ea2ef63-b8ff-41df-bfc6-c96f7677fdd8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:55.191277 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4ea2ef63-b8ff-41df-bfc6-c96f7677fdd8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:55.192026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4ea2ef63-b8ff-41df-bfc6-c96f7677fdd8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:55.192466 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4ea2ef63-b8ff-41df-bfc6-c96f7677fdd8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:55.193198 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4ea2ef63-b8ff-41df-bfc6-c96f7677fdd8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:55.193649 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4ea2ef63-b8ff-41df-bfc6-c96f7677fdd8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:55.194086 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4ea2ef63-b8ff-41df-bfc6-c96f7677fdd8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:55.398023 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4ea2ef63-b8ff-41df-bfc6-c96f7677fdd8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:55.406757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4ea2ef63-b8ff-41df-bfc6-c96f7677fdd8 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1750 microversion: 2.1 time: 0.226494 Aug 08 16:57:55.407343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 383/772] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:55 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1750 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:55.714552 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c8de0fca-a548-4e0e-b56d-18a524d7ae88 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:55.715208 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c8de0fca-a548-4e0e-b56d-18a524d7ae88 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:55.717711 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:55.723034 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8de0fca-a548-4e0e-b56d-18a524d7ae88 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:55.723530 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8de0fca-a548-4e0e-b56d-18a524d7ae88 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:55.723973 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8de0fca-a548-4e0e-b56d-18a524d7ae88 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:55.724795 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8de0fca-a548-4e0e-b56d-18a524d7ae88 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:55.725193 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8de0fca-a548-4e0e-b56d-18a524d7ae88 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:55.725633 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8de0fca-a548-4e0e-b56d-18a524d7ae88 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:55.816191 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c8de0fca-a548-4e0e-b56d-18a524d7ae88 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:55.824723 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-891a5f99-70cc-40df-9687-a5e18793aa44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:55.825851 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-891a5f99-70cc-40df-9687-a5e18793aa44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:55.830508 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c8de0fca-a548-4e0e-b56d-18a524d7ae88 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1245 microversion: 2.1 time: 0.120319 Aug 08 16:57:55.831576 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 390/773] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:55 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:55.835884 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-891a5f99-70cc-40df-9687-a5e18793aa44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:55.840804 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-891a5f99-70cc-40df-9687-a5e18793aa44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:55.840804 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-891a5f99-70cc-40df-9687-a5e18793aa44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:55.840804 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-891a5f99-70cc-40df-9687-a5e18793aa44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:55.840804 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-891a5f99-70cc-40df-9687-a5e18793aa44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:55.841489 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-891a5f99-70cc-40df-9687-a5e18793aa44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:56.017112 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0b6798b2-7faa-4406-808c-5a01747a0d0c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:56.019068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0b6798b2-7faa-4406-808c-5a01747a0d0c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:56.035733 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b6798b2-7faa-4406-808c-5a01747a0d0c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:56.036538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b6798b2-7faa-4406-808c-5a01747a0d0c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:56.037609 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b6798b2-7faa-4406-808c-5a01747a0d0c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:56.039130 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b6798b2-7faa-4406-808c-5a01747a0d0c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:56.040021 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b6798b2-7faa-4406-808c-5a01747a0d0c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:56.040622 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b6798b2-7faa-4406-808c-5a01747a0d0c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:56.064268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-891a5f99-70cc-40df-9687-a5e18793aa44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:56.087341 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-891a5f99-70cc-40df-9687-a5e18793aa44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:56.091133 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-891a5f99-70cc-40df-9687-a5e18793aa44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:56.093821 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-891a5f99-70cc-40df-9687-a5e18793aa44 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.278854 Aug 08 16:57:56.094962 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 384/774] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:55 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:57:56.265959 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0b6798b2-7faa-4406-808c-5a01747a0d0c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:56.296887 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0b6798b2-7faa-4406-808c-5a01747a0d0c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.287550 Aug 08 16:57:56.300381 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 391/775] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:56 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:56.435829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b83afd8f-6a5c-4823-b17e-774fc9fd3f5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:56.438012 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b83afd8f-6a5c-4823-b17e-774fc9fd3f5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:56.450346 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b83afd8f-6a5c-4823-b17e-774fc9fd3f5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:56.451250 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b83afd8f-6a5c-4823-b17e-774fc9fd3f5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:56.452039 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b83afd8f-6a5c-4823-b17e-774fc9fd3f5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:56.453336 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b83afd8f-6a5c-4823-b17e-774fc9fd3f5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:56.454164 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b83afd8f-6a5c-4823-b17e-774fc9fd3f5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:56.454934 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b83afd8f-6a5c-4823-b17e-774fc9fd3f5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:56.674326 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b83afd8f-6a5c-4823-b17e-774fc9fd3f5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:56.686338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b83afd8f-6a5c-4823-b17e-774fc9fd3f5f tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1750 microversion: 2.1 time: 0.260523 Aug 08 16:57:56.687380 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 385/776] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:56 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1750 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:56.868841 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-00e37148-605e-4520-a081-2dd43bc5d9d0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:56.869907 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-00e37148-605e-4520-a081-2dd43bc5d9d0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:56.888444 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00e37148-605e-4520-a081-2dd43bc5d9d0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:56.889659 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00e37148-605e-4520-a081-2dd43bc5d9d0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:56.890712 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00e37148-605e-4520-a081-2dd43bc5d9d0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:56.892198 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00e37148-605e-4520-a081-2dd43bc5d9d0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:56.893389 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00e37148-605e-4520-a081-2dd43bc5d9d0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:56.894364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00e37148-605e-4520-a081-2dd43bc5d9d0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:56.982672 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-00e37148-605e-4520-a081-2dd43bc5d9d0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:56.991788 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-00e37148-605e-4520-a081-2dd43bc5d9d0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1293 microversion: 2.1 time: 0.129193 Aug 08 16:57:57.002896 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 392/777] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:56 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1293 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:57.159771 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ddf388c5-7438-483d-b6b9-ba84d42e366e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:57.164332 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ddf388c5-7438-483d-b6b9-ba84d42e366e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:57.217728 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ddf388c5-7438-483d-b6b9-ba84d42e366e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:57.223709 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ddf388c5-7438-483d-b6b9-ba84d42e366e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:57.224068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ddf388c5-7438-483d-b6b9-ba84d42e366e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:57.228413 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ddf388c5-7438-483d-b6b9-ba84d42e366e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:57.233462 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ddf388c5-7438-483d-b6b9-ba84d42e366e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:57.238054 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ddf388c5-7438-483d-b6b9-ba84d42e366e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:57.345013 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c50d6017-0891-4b80-b04b-91a59641ac0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:57.348951 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c50d6017-0891-4b80-b04b-91a59641ac0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:57.352798 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:57.371330 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c50d6017-0891-4b80-b04b-91a59641ac0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:57.372132 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c50d6017-0891-4b80-b04b-91a59641ac0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:57.373052 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c50d6017-0891-4b80-b04b-91a59641ac0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:57.374060 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c50d6017-0891-4b80-b04b-91a59641ac0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:57.374855 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c50d6017-0891-4b80-b04b-91a59641ac0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:57.375561 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c50d6017-0891-4b80-b04b-91a59641ac0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:57.468544 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ddf388c5-7438-483d-b6b9-ba84d42e366e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:57.484451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ddf388c5-7438-483d-b6b9-ba84d42e366e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:57.487107 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ddf388c5-7438-483d-b6b9-ba84d42e366e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:57.488792 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ddf388c5-7438-483d-b6b9-ba84d42e366e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.348410 Aug 08 16:57:57.489716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 386/778] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:57 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:57.564380 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c50d6017-0891-4b80-b04b-91a59641ac0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:57.580114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c50d6017-0891-4b80-b04b-91a59641ac0b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.247908 Aug 08 16:57:57.581092 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 393/779] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:57 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:57.712195 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ae871389-3f8c-4847-982e-ce4a8090caa9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:57.712807 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ae871389-3f8c-4847-982e-ce4a8090caa9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:57.719410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae871389-3f8c-4847-982e-ce4a8090caa9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:57.719930 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae871389-3f8c-4847-982e-ce4a8090caa9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:57.720360 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae871389-3f8c-4847-982e-ce4a8090caa9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:57.721049 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae871389-3f8c-4847-982e-ce4a8090caa9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:57.721531 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae871389-3f8c-4847-982e-ce4a8090caa9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:57.721956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae871389-3f8c-4847-982e-ce4a8090caa9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:57.905310 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ae871389-3f8c-4847-982e-ce4a8090caa9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:57.921673 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ae871389-3f8c-4847-982e-ce4a8090caa9 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.213651 Aug 08 16:57:57.922763 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 387/780] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:57 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:58.014310 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1e3f89e7-6c2d-45a8-9524-b77d702ceb87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:58.015095 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1e3f89e7-6c2d-45a8-9524-b77d702ceb87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:58.023902 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1e3f89e7-6c2d-45a8-9524-b77d702ceb87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:58.023902 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1e3f89e7-6c2d-45a8-9524-b77d702ceb87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:58.024368 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1e3f89e7-6c2d-45a8-9524-b77d702ceb87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:58.024950 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1e3f89e7-6c2d-45a8-9524-b77d702ceb87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:58.025413 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1e3f89e7-6c2d-45a8-9524-b77d702ceb87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:58.025840 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1e3f89e7-6c2d-45a8-9524-b77d702ceb87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:58.095832 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1e3f89e7-6c2d-45a8-9524-b77d702ceb87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:58.104809 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1e3f89e7-6c2d-45a8-9524-b77d702ceb87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1311 microversion: 2.1 time: 0.094520 Aug 08 16:57:58.105405 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 394/781] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:58 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:58.527876 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-766d2097-b34a-4742-ace3-9cd342e5f6fa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:58.529211 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-766d2097-b34a-4742-ace3-9cd342e5f6fa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:58.536763 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-766d2097-b34a-4742-ace3-9cd342e5f6fa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:58.538996 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-766d2097-b34a-4742-ace3-9cd342e5f6fa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:58.538996 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-766d2097-b34a-4742-ace3-9cd342e5f6fa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:58.539323 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-766d2097-b34a-4742-ace3-9cd342e5f6fa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:58.539607 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-766d2097-b34a-4742-ace3-9cd342e5f6fa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:58.540304 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-766d2097-b34a-4742-ace3-9cd342e5f6fa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:58.605174 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-bf969b01-d1f7-4ce5-8830-4b5597b2051f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:58.606780 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-bf969b01-d1f7-4ce5-8830-4b5597b2051f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:58.616799 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf969b01-d1f7-4ce5-8830-4b5597b2051f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:58.617420 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf969b01-d1f7-4ce5-8830-4b5597b2051f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:58.617865 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf969b01-d1f7-4ce5-8830-4b5597b2051f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:58.618906 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf969b01-d1f7-4ce5-8830-4b5597b2051f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:58.619379 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf969b01-d1f7-4ce5-8830-4b5597b2051f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:58.619904 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf969b01-d1f7-4ce5-8830-4b5597b2051f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:58.828260 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=10 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:58.864712 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bf969b01-d1f7-4ce5-8830-4b5597b2051f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:58.880185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-bf969b01-d1f7-4ce5-8830-4b5597b2051f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.279052 Aug 08 16:57:58.881306 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 395/782] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:58 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:58.900464 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-766d2097-b34a-4742-ace3-9cd342e5f6fa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:58.911489 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-766d2097-b34a-4742-ace3-9cd342e5f6fa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:58.913217 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-766d2097-b34a-4742-ace3-9cd342e5f6fa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:58.914482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-766d2097-b34a-4742-ace3-9cd342e5f6fa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.394299 Aug 08 16:57:58.915104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 388/783] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:58 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:57:58.964322 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9bc85158-e2ab-43e9-8ed3-68ceccb0aec7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:58.964945 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9bc85158-e2ab-43e9-8ed3-68ceccb0aec7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:58.972061 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9bc85158-e2ab-43e9-8ed3-68ceccb0aec7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:58.972609 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9bc85158-e2ab-43e9-8ed3-68ceccb0aec7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:58.973108 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9bc85158-e2ab-43e9-8ed3-68ceccb0aec7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:58.973836 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9bc85158-e2ab-43e9-8ed3-68ceccb0aec7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:58.974293 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9bc85158-e2ab-43e9-8ed3-68ceccb0aec7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:58.974776 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9bc85158-e2ab-43e9-8ed3-68ceccb0aec7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:59.149853 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a833292e-1e55-475e-a041-4b3353821137 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:59.150998 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a833292e-1e55-475e-a041-4b3353821137 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:59.159668 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a833292e-1e55-475e-a041-4b3353821137 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:59.160565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a833292e-1e55-475e-a041-4b3353821137 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:59.161182 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a833292e-1e55-475e-a041-4b3353821137 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:59.162452 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a833292e-1e55-475e-a041-4b3353821137 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:59.163628 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a833292e-1e55-475e-a041-4b3353821137 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:59.164327 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a833292e-1e55-475e-a041-4b3353821137 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:59.172136 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9bc85158-e2ab-43e9-8ed3-68ceccb0aec7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:59.196090 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9bc85158-e2ab-43e9-8ed3-68ceccb0aec7 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.230997 Aug 08 16:57:59.197407 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 396/784] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:58 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:59.296888 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a833292e-1e55-475e-a041-4b3353821137 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:57:59.299431 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=100 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:57:59.306742 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a833292e-1e55-475e-a041-4b3353821137 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1299 microversion: 2.1 time: 0.162026 Aug 08 16:57:59.307786 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 389/785] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:59 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1299 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:57:59.910216 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-27ac68aa-1e07-42e0-96d2-9ca75ca397f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:59.911588 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-27ac68aa-1e07-42e0-96d2-9ca75ca397f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:59.932344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27ac68aa-1e07-42e0-96d2-9ca75ca397f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:59.932344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27ac68aa-1e07-42e0-96d2-9ca75ca397f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:59.932344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27ac68aa-1e07-42e0-96d2-9ca75ca397f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:59.932344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27ac68aa-1e07-42e0-96d2-9ca75ca397f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:59.933104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27ac68aa-1e07-42e0-96d2-9ca75ca397f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:59.933104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-27ac68aa-1e07-42e0-96d2-9ca75ca397f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:59.961013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-58407ef4-9b47-4b23-a8a1-e5ab19ba6669 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:57:59.961013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-58407ef4-9b47-4b23-a8a1-e5ab19ba6669 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:57:59.971453 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-58407ef4-9b47-4b23-a8a1-e5ab19ba6669 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:59.972439 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-58407ef4-9b47-4b23-a8a1-e5ab19ba6669 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:59.973284 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-58407ef4-9b47-4b23-a8a1-e5ab19ba6669 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:57:59.974657 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-58407ef4-9b47-4b23-a8a1-e5ab19ba6669 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:57:59.975552 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-58407ef4-9b47-4b23-a8a1-e5ab19ba6669 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:57:59.976381 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-58407ef4-9b47-4b23-a8a1-e5ab19ba6669 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:00.164450 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-27ac68aa-1e07-42e0-96d2-9ca75ca397f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:00.174135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-27ac68aa-1e07-42e0-96d2-9ca75ca397f6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1736 microversion: 2.1 time: 0.271756 Aug 08 16:58:00.174922 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 397/786] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:57:59 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1736 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:00.220532 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-833466be-dd6a-4338-b02e-cdfbba16bf38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:00.224206 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-833466be-dd6a-4338-b02e-cdfbba16bf38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:00.231263 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-833466be-dd6a-4338-b02e-cdfbba16bf38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:00.231995 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-833466be-dd6a-4338-b02e-cdfbba16bf38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:00.232579 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-833466be-dd6a-4338-b02e-cdfbba16bf38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:00.233494 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-833466be-dd6a-4338-b02e-cdfbba16bf38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:00.234338 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-833466be-dd6a-4338-b02e-cdfbba16bf38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:00.235147 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-833466be-dd6a-4338-b02e-cdfbba16bf38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:00.420782 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-833466be-dd6a-4338-b02e-cdfbba16bf38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:00.429836 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-833466be-dd6a-4338-b02e-cdfbba16bf38 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.214399 Aug 08 16:58:00.430417 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 398/787] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:00 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:00.439806 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-80d24420-edb3-42cc-b96f-4bd1cba8f830 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:00.440668 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-80d24420-edb3-42cc-b96f-4bd1cba8f830 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:00.441504 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-58407ef4-9b47-4b23-a8a1-e5ab19ba6669 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:00.450408 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80d24420-edb3-42cc-b96f-4bd1cba8f830 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:00.451127 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80d24420-edb3-42cc-b96f-4bd1cba8f830 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:00.451769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80d24420-edb3-42cc-b96f-4bd1cba8f830 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:00.452626 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80d24420-edb3-42cc-b96f-4bd1cba8f830 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:00.453252 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80d24420-edb3-42cc-b96f-4bd1cba8f830 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:00.453792 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80d24420-edb3-42cc-b96f-4bd1cba8f830 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:00.457863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-58407ef4-9b47-4b23-a8a1-e5ab19ba6669 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:00.461699 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-58407ef4-9b47-4b23-a8a1-e5ab19ba6669 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:00.464716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-58407ef4-9b47-4b23-a8a1-e5ab19ba6669 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.514538 Aug 08 16:58:00.466056 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 390/788] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:57:59 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:58:00.634952 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-80d24420-edb3-42cc-b96f-4bd1cba8f830 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:00.649519 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-80d24420-edb3-42cc-b96f-4bd1cba8f830 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1367 microversion: 2.1 time: 0.213230 Aug 08 16:58:00.651168 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 399/789] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:00 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:01.173858 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-349b283c-120e-42e0-95cc-8fdbfdfef07e req-b968327f-f296-4c7c-a72b-d7fa1d47b321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d228b747-dc71-4145-bc09-820362dc7fc3", "tag": "0679f117-d099-44e2-88f2-6601e3adbc88"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:01.191641 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-349b283c-120e-42e0-95cc-8fdbfdfef07e req-b968327f-f296-4c7c-a72b-d7fa1d47b321 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:01.192916 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-349b283c-120e-42e0-95cc-8fdbfdfef07e req-b968327f-f296-4c7c-a72b-d7fa1d47b321 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:01.193632 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-349b283c-120e-42e0-95cc-8fdbfdfef07e req-b968327f-f296-4c7c-a72b-d7fa1d47b321 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:01.200291 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-60235757-589d-4907-8c67-75ecc117d2b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:01.202075 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-60235757-589d-4907-8c67-75ecc117d2b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:01.213095 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-60235757-589d-4907-8c67-75ecc117d2b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:01.213905 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-60235757-589d-4907-8c67-75ecc117d2b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:01.214548 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-60235757-589d-4907-8c67-75ecc117d2b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:01.215675 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-349b283c-120e-42e0-95cc-8fdbfdfef07e req-b968327f-f296-4c7c-a72b-d7fa1d47b321 service nova] Creating event network-changed:0679f117-d099-44e2-88f2-6601e3adbc88 for instance d228b747-dc71-4145-bc09-820362dc7fc3 on hv-cinder-85220 Aug 08 16:58:01.216372 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-60235757-589d-4907-8c67-75ecc117d2b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:01.217342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-60235757-589d-4907-8c67-75ecc117d2b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:01.218344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-60235757-589d-4907-8c67-75ecc117d2b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:01.225116 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-349b283c-120e-42e0-95cc-8fdbfdfef07e req-b968327f-f296-4c7c-a72b-d7fa1d47b321 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057430 Aug 08 16:58:01.226853 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 391/790] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:01.436687 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-60235757-589d-4907-8c67-75ecc117d2b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:01.446734 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-60235757-589d-4907-8c67-75ecc117d2b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1716 microversion: 2.1 time: 0.252161 Aug 08 16:58:01.447263 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 400/791] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:01 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1716 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:01.455325 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d7b1c6ff-0b9c-4b6d-93f1-9dd91bce1ff0 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:01.456693 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d7b1c6ff-0b9c-4b6d-93f1-9dd91bce1ff0 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:01.466944 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d7b1c6ff-0b9c-4b6d-93f1-9dd91bce1ff0 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:01.467813 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d7b1c6ff-0b9c-4b6d-93f1-9dd91bce1ff0 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:01.468553 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d7b1c6ff-0b9c-4b6d-93f1-9dd91bce1ff0 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:01.470070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d7b1c6ff-0b9c-4b6d-93f1-9dd91bce1ff0 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:01.471011 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d7b1c6ff-0b9c-4b6d-93f1-9dd91bce1ff0 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:01.471551 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d7b1c6ff-0b9c-4b6d-93f1-9dd91bce1ff0 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:01.510667 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a3823113-5741-483e-bd00-b33b6d2ea783 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:01.511613 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a3823113-5741-483e-bd00-b33b6d2ea783 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:01.519957 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a3823113-5741-483e-bd00-b33b6d2ea783 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:01.520664 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a3823113-5741-483e-bd00-b33b6d2ea783 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:01.521198 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a3823113-5741-483e-bd00-b33b6d2ea783 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:01.522061 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a3823113-5741-483e-bd00-b33b6d2ea783 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:01.522683 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a3823113-5741-483e-bd00-b33b6d2ea783 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:01.523203 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a3823113-5741-483e-bd00-b33b6d2ea783 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:01.681161 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d7b1c6ff-0b9c-4b6d-93f1-9dd91bce1ff0 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:01.696659 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d7b1c6ff-0b9c-4b6d-93f1-9dd91bce1ff0 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.246662 Aug 08 16:58:01.697717 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 392/792] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:01 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:01.707086 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8dfb4d18-42a8-4edf-8cca-c11b8948eaf1 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:01.707640 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8dfb4d18-42a8-4edf-8cca-c11b8948eaf1 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:01.718764 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a3823113-5741-483e-bd00-b33b6d2ea783 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:01.720763 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8dfb4d18-42a8-4edf-8cca-c11b8948eaf1 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:01.726704 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8dfb4d18-42a8-4edf-8cca-c11b8948eaf1 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:01.726704 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8dfb4d18-42a8-4edf-8cca-c11b8948eaf1 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:01.726704 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8dfb4d18-42a8-4edf-8cca-c11b8948eaf1 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:01.726704 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8dfb4d18-42a8-4edf-8cca-c11b8948eaf1 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:01.727133 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8dfb4d18-42a8-4edf-8cca-c11b8948eaf1 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:01.734358 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a3823113-5741-483e-bd00-b33b6d2ea783 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:01.736019 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a3823113-5741-483e-bd00-b33b6d2ea783 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:01.737299 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a3823113-5741-483e-bd00-b33b6d2ea783 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.233688 Aug 08 16:58:01.737878 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 401/793] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:58:01 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:58:01.755612 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6d12a920-8fd4-4223-a0ad-f132ee554077 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:01.756260 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6d12a920-8fd4-4223-a0ad-f132ee554077 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:01.764610 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6d12a920-8fd4-4223-a0ad-f132ee554077 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:01.765288 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6d12a920-8fd4-4223-a0ad-f132ee554077 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:01.765905 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6d12a920-8fd4-4223-a0ad-f132ee554077 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:01.766674 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6d12a920-8fd4-4223-a0ad-f132ee554077 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:01.767145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6d12a920-8fd4-4223-a0ad-f132ee554077 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:01.767577 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6d12a920-8fd4-4223-a0ad-f132ee554077 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:01.832489 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-8dfb4d18-42a8-4edf-8cca-c11b8948eaf1 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] HTTP exception thrown: Cannot 'detach_volume' instance af731dd6-88e0-49bd-b38b-3b629bf771bb while it is in vm_state rescued Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8dfb4d18-42a8-4edf-8cca-c11b8948eaf1 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Request method failure captured: Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: DELETE /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-volume_attachments/fad196b8-b7c0-4baf-a7cb-e60187f87ce5 HTTP/1.1 Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8w-K7laAEb2eqcpAcIQgFUL6kuL4XLbKHs4o9M-2KdcOOU83uXV2cxJjak-BJlSZljXiBu3GBNqSP4Yv2wtKGu8Kt7fn3jcSbSzg6UkIEqkYSp3Fw6_bcPoQdHG8VL8tlrNTQRdwt7oFp1kxR960UJj4ylfDEF571Gojp3_bb3VaQ Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 6cac5ca5a8b04bce9a9d8ac938cd35e8 Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:58:01.834225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:58:01.835939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6cac5ca5a8b04bce9a9d8ac938cd35e8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:58:01.835939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:58:01.835939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 6cac5ca5a8b04bce9a9d8ac938cd35e8 Aug 08 16:58:01.835939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:58:01.835939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-ServerRescueNegativeTestJSON-1491888347-project Aug 08 16:58:01.835939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:58:01.835939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:58:01.835939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: 75d793a42ec74232899b7a19e36b5867 Aug 08 16:58:01.835939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491888347-project Aug 08 16:58:01.835939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:58:01.835939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Cannot 'detach_volume' instance af731dd6-88e0-49bd-b38b-3b629bf771bb while it is in vm_state rescued Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'server_id': 'af731dd6-88e0-49bd-b38b-3b629bf771bb', 'id': 'fad196b8-b7c0-4baf-a7cb-e60187f87ce5'} Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af731dd6-88e0-49bd-b38b-3b629bf771bb in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:58:01.836764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance af731dd6-88e0-49bd-b38b-3b629bf771bb while it is in vm_state rescued Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance af731dd6-88e0-49bd-b38b-3b629bf771bb while it is in vm_state rescued Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:58:01.838156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8dfb4d18-42a8-4edf-8cca-c11b8948eaf1 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Returning 409 to user: Cannot 'detach_volume' instance af731dd6-88e0-49bd-b38b-3b629bf771bb while it is in vm_state rescued {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:58:01.839396 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8dfb4d18-42a8-4edf-8cca-c11b8948eaf1 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "DELETE /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-volume_attachments/fad196b8-b7c0-4baf-a7cb-e60187f87ce5" status: 409 len: 152 microversion: 2.1 time: 0.137046 Aug 08 16:58:01.839396 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 393/794] 10.222.0.13 () {58 vars in 1416 bytes} [Mon Aug 8 16:58:01 2022] DELETE /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-volume_attachments/fad196b8-b7c0-4baf-a7cb-e60187f87ce5 => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 16:58:01.845886 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d4c6994c-e5de-4ee1-a12e-228038aa51e5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:01.846419 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d4c6994c-e5de-4ee1-a12e-228038aa51e5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:01.854406 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4c6994c-e5de-4ee1-a12e-228038aa51e5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:01.854993 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4c6994c-e5de-4ee1-a12e-228038aa51e5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:01.855371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4c6994c-e5de-4ee1-a12e-228038aa51e5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:01.856101 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4c6994c-e5de-4ee1-a12e-228038aa51e5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:01.856565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4c6994c-e5de-4ee1-a12e-228038aa51e5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:01.857224 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4c6994c-e5de-4ee1-a12e-228038aa51e5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:01.944886 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6d12a920-8fd4-4223-a0ad-f132ee554077 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:01.954167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6d12a920-8fd4-4223-a0ad-f132ee554077 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1367 microversion: 2.1 time: 0.215012 Aug 08 16:58:01.954875 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 402/795] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:01 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:02.110288 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d4c6994c-e5de-4ee1-a12e-228038aa51e5 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "POST /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/action" status: 202 len: 0 microversion: 2.1 time: 0.268152 Aug 08 16:58:02.110981 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 394/796] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 16:58:01 2022] POST /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 16:58:02.121046 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-70035ee1-ef7b-4424-ab94-be8b1fe4311c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:02.121665 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-70035ee1-ef7b-4424-ab94-be8b1fe4311c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:02.129531 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70035ee1-ef7b-4424-ab94-be8b1fe4311c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:02.130389 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70035ee1-ef7b-4424-ab94-be8b1fe4311c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:02.131193 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70035ee1-ef7b-4424-ab94-be8b1fe4311c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:02.133088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70035ee1-ef7b-4424-ab94-be8b1fe4311c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:02.133912 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70035ee1-ef7b-4424-ab94-be8b1fe4311c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:02.134698 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70035ee1-ef7b-4424-ab94-be8b1fe4311c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:02.304466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-70035ee1-ef7b-4424-ab94-be8b1fe4311c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:02.313619 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-70035ee1-ef7b-4424-ab94-be8b1fe4311c tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1724 microversion: 2.1 time: 0.197676 Aug 08 16:58:02.314215 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 403/797] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:02 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:02.721360 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3018e1d4-fe08-41c8-9291-81834f6fff45 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:02.722290 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-3018e1d4-fe08-41c8-9291-81834f6fff45 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:02.730736 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3018e1d4-fe08-41c8-9291-81834f6fff45 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:02.731241 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3018e1d4-fe08-41c8-9291-81834f6fff45 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:02.731741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3018e1d4-fe08-41c8-9291-81834f6fff45 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:02.732497 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3018e1d4-fe08-41c8-9291-81834f6fff45 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:02.732992 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3018e1d4-fe08-41c8-9291-81834f6fff45 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:02.733420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3018e1d4-fe08-41c8-9291-81834f6fff45 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:02.784057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0fae747a-255c-4349-9940-60d98fc34fda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:02.784625 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0fae747a-255c-4349-9940-60d98fc34fda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:02.792768 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fae747a-255c-4349-9940-60d98fc34fda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:02.793271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fae747a-255c-4349-9940-60d98fc34fda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:02.793714 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fae747a-255c-4349-9940-60d98fc34fda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:02.794488 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fae747a-255c-4349-9940-60d98fc34fda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:02.794986 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fae747a-255c-4349-9940-60d98fc34fda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:02.795417 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fae747a-255c-4349-9940-60d98fc34fda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:02.991556 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0fae747a-255c-4349-9940-60d98fc34fda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:03.001087 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0fae747a-255c-4349-9940-60d98fc34fda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:03.003077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0fae747a-255c-4349-9940-60d98fc34fda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:03.004302 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0fae747a-255c-4349-9940-60d98fc34fda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.225125 Aug 08 16:58:03.004895 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 404/798] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:58:02 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:58:03.010535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7b975c8b-af7d-45e0-9d2f-9421e2ead8d4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:03.011531 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7b975c8b-af7d-45e0-9d2f-9421e2ead8d4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:03.018759 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7b975c8b-af7d-45e0-9d2f-9421e2ead8d4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:03.019563 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7b975c8b-af7d-45e0-9d2f-9421e2ead8d4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:03.020159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7b975c8b-af7d-45e0-9d2f-9421e2ead8d4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:03.021322 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7b975c8b-af7d-45e0-9d2f-9421e2ead8d4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:03.021547 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7b975c8b-af7d-45e0-9d2f-9421e2ead8d4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:03.022261 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7b975c8b-af7d-45e0-9d2f-9421e2ead8d4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:03.042728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=100 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:03.189774 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7b975c8b-af7d-45e0-9d2f-9421e2ead8d4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:03.199519 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7b975c8b-af7d-45e0-9d2f-9421e2ead8d4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1367 microversion: 2.1 time: 0.193296 Aug 08 16:58:03.200183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 405/799] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:03 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:03.319176 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-3018e1d4-fe08-41c8-9291-81834f6fff45 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:03.328286 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-3018e1d4-fe08-41c8-9291-81834f6fff45 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.611692 Aug 08 16:58:03.328883 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 395/800] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:02 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:03.349829 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a52b1a8c-6170-4477-a36f-a02ee2e75947 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:03.352673 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a52b1a8c-6170-4477-a36f-a02ee2e75947 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:03.358978 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a52b1a8c-6170-4477-a36f-a02ee2e75947 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:03.359474 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a52b1a8c-6170-4477-a36f-a02ee2e75947 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:03.359955 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a52b1a8c-6170-4477-a36f-a02ee2e75947 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:03.360685 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a52b1a8c-6170-4477-a36f-a02ee2e75947 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:03.361185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a52b1a8c-6170-4477-a36f-a02ee2e75947 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:03.361585 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a52b1a8c-6170-4477-a36f-a02ee2e75947 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:03.522140 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a52b1a8c-6170-4477-a36f-a02ee2e75947 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:03.535822 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a52b1a8c-6170-4477-a36f-a02ee2e75947 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1724 microversion: 2.1 time: 0.190239 Aug 08 16:58:03.537105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 406/801] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:03 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:04.038009 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8ba5f704-8265-434a-b6d0-39196480be7d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:04.039789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8ba5f704-8265-434a-b6d0-39196480be7d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:04.047430 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8ba5f704-8265-434a-b6d0-39196480be7d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:04.047938 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8ba5f704-8265-434a-b6d0-39196480be7d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:04.048374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8ba5f704-8265-434a-b6d0-39196480be7d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:04.049153 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8ba5f704-8265-434a-b6d0-39196480be7d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:04.049647 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8ba5f704-8265-434a-b6d0-39196480be7d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:04.050078 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8ba5f704-8265-434a-b6d0-39196480be7d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:04.222547 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0013c530-700d-49b7-bba8-b8184f25b865 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:04.223362 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0013c530-700d-49b7-bba8-b8184f25b865 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:04.230907 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0013c530-700d-49b7-bba8-b8184f25b865 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:04.231489 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0013c530-700d-49b7-bba8-b8184f25b865 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:04.232143 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0013c530-700d-49b7-bba8-b8184f25b865 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:04.232941 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0013c530-700d-49b7-bba8-b8184f25b865 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:04.233580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0013c530-700d-49b7-bba8-b8184f25b865 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:04.234245 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0013c530-700d-49b7-bba8-b8184f25b865 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:04.309596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8ba5f704-8265-434a-b6d0-39196480be7d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:04.323959 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8ba5f704-8265-434a-b6d0-39196480be7d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:04.327173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8ba5f704-8265-434a-b6d0-39196480be7d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:04.329020 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8ba5f704-8265-434a-b6d0-39196480be7d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.297386 Aug 08 16:58:04.329795 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 396/802] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:58:04 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:58:04.358034 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3fe09f46-2e01-495c-bec9-aa4131fd9946 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:04.359429 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-3fe09f46-2e01-495c-bec9-aa4131fd9946 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:04.365472 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:04.373358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3fe09f46-2e01-495c-bec9-aa4131fd9946 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:04.374772 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3fe09f46-2e01-495c-bec9-aa4131fd9946 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:04.375856 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3fe09f46-2e01-495c-bec9-aa4131fd9946 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:04.377382 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3fe09f46-2e01-495c-bec9-aa4131fd9946 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:04.378616 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3fe09f46-2e01-495c-bec9-aa4131fd9946 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:04.379735 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3fe09f46-2e01-495c-bec9-aa4131fd9946 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:04.405710 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0013c530-700d-49b7-bba8-b8184f25b865 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:04.414009 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0013c530-700d-49b7-bba8-b8184f25b865 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1367 microversion: 2.1 time: 0.195737 Aug 08 16:58:04.414682 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 407/803] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:04 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:04.554517 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-3fe09f46-2e01-495c-bec9-aa4131fd9946 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:04.563281 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-3fe09f46-2e01-495c-bec9-aa4131fd9946 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.213954 Aug 08 16:58:04.563872 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 397/804] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:04 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:04.573368 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-51a0fb4c-fc7c-476b-b3ce-70d6e27df084 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:04.574153 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-51a0fb4c-fc7c-476b-b3ce-70d6e27df084 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:04.581845 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-51a0fb4c-fc7c-476b-b3ce-70d6e27df084 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:04.589150 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-51a0fb4c-fc7c-476b-b3ce-70d6e27df084 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:04.589150 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-51a0fb4c-fc7c-476b-b3ce-70d6e27df084 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:04.589150 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-51a0fb4c-fc7c-476b-b3ce-70d6e27df084 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:04.589150 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-51a0fb4c-fc7c-476b-b3ce-70d6e27df084 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:04.589604 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-51a0fb4c-fc7c-476b-b3ce-70d6e27df084 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:04.736338 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-51a0fb4c-fc7c-476b-b3ce-70d6e27df084 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:04.749822 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-51a0fb4c-fc7c-476b-b3ce-70d6e27df084 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1724 microversion: 2.1 time: 0.181521 Aug 08 16:58:04.755190 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 408/805] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:04 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:05.373090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-912f2d62-2526-4c1d-8605-84bf0851b0f1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:05.373743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-912f2d62-2526-4c1d-8605-84bf0851b0f1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:05.382353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-912f2d62-2526-4c1d-8605-84bf0851b0f1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:05.383000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-912f2d62-2526-4c1d-8605-84bf0851b0f1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:05.383473 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-912f2d62-2526-4c1d-8605-84bf0851b0f1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:05.384219 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-912f2d62-2526-4c1d-8605-84bf0851b0f1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:05.384674 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-912f2d62-2526-4c1d-8605-84bf0851b0f1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:05.385337 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-912f2d62-2526-4c1d-8605-84bf0851b0f1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:05.438037 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5164d2ed-ec40-4137-ac57-c4a930ee5925 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:05.439564 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5164d2ed-ec40-4137-ac57-c4a930ee5925 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:05.449308 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5164d2ed-ec40-4137-ac57-c4a930ee5925 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:05.449809 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5164d2ed-ec40-4137-ac57-c4a930ee5925 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:05.450300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5164d2ed-ec40-4137-ac57-c4a930ee5925 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:05.450999 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5164d2ed-ec40-4137-ac57-c4a930ee5925 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:05.451505 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5164d2ed-ec40-4137-ac57-c4a930ee5925 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:05.452767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5164d2ed-ec40-4137-ac57-c4a930ee5925 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:05.595899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-912f2d62-2526-4c1d-8605-84bf0851b0f1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:05.613451 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-5164d2ed-ec40-4137-ac57-c4a930ee5925 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:05.619479 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-912f2d62-2526-4c1d-8605-84bf0851b0f1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:05.622881 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-912f2d62-2526-4c1d-8605-84bf0851b0f1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:05.623319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5164d2ed-ec40-4137-ac57-c4a930ee5925 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1367 microversion: 2.1 time: 0.190612 Aug 08 16:58:05.626987 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 409/806] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:05 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:05.628126 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-912f2d62-2526-4c1d-8605-84bf0851b0f1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.256051 Aug 08 16:58:05.628126 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 398/807] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:58:05 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:58:05.633756 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a6434278-43b3-4029-8d97-a62ad4ceda5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:05.635403 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a6434278-43b3-4029-8d97-a62ad4ceda5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:05.643953 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6434278-43b3-4029-8d97-a62ad4ceda5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:05.644522 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6434278-43b3-4029-8d97-a62ad4ceda5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:05.644975 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6434278-43b3-4029-8d97-a62ad4ceda5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:05.645744 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6434278-43b3-4029-8d97-a62ad4ceda5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:05.646317 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6434278-43b3-4029-8d97-a62ad4ceda5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:05.646992 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a6434278-43b3-4029-8d97-a62ad4ceda5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:05.774772 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b8d005d6-ebf9-4e1d-9176-e9c45b0e9140 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:05.775418 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b8d005d6-ebf9-4e1d-9176-e9c45b0e9140 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:05.782368 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b8d005d6-ebf9-4e1d-9176-e9c45b0e9140 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:05.783505 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b8d005d6-ebf9-4e1d-9176-e9c45b0e9140 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:05.784169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b8d005d6-ebf9-4e1d-9176-e9c45b0e9140 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:05.785255 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b8d005d6-ebf9-4e1d-9176-e9c45b0e9140 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:05.785814 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b8d005d6-ebf9-4e1d-9176-e9c45b0e9140 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:05.786537 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b8d005d6-ebf9-4e1d-9176-e9c45b0e9140 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:05.826266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a6434278-43b3-4029-8d97-a62ad4ceda5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:05.844672 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a6434278-43b3-4029-8d97-a62ad4ceda5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.218966 Aug 08 16:58:05.845517 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 410/808] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:05 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:05.951660 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b8d005d6-ebf9-4e1d-9176-e9c45b0e9140 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:05.963572 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b8d005d6-ebf9-4e1d-9176-e9c45b0e9140 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1724 microversion: 2.1 time: 0.193612 Aug 08 16:58:05.964581 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 399/809] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:05 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:06.649593 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1729b4c3-4d8c-4641-8bb8-fd95e7b1ce0a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:06.650641 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1729b4c3-4d8c-4641-8bb8-fd95e7b1ce0a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:06.652677 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2e906618-aa1d-4096-aea9-c9cae1d15e03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:06.653681 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2e906618-aa1d-4096-aea9-c9cae1d15e03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:06.660728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1729b4c3-4d8c-4641-8bb8-fd95e7b1ce0a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:06.661538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1729b4c3-4d8c-4641-8bb8-fd95e7b1ce0a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:06.662093 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1729b4c3-4d8c-4641-8bb8-fd95e7b1ce0a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:06.663097 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2e906618-aa1d-4096-aea9-c9cae1d15e03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:06.663291 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1729b4c3-4d8c-4641-8bb8-fd95e7b1ce0a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:06.663753 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2e906618-aa1d-4096-aea9-c9cae1d15e03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:06.663984 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1729b4c3-4d8c-4641-8bb8-fd95e7b1ce0a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:06.664378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2e906618-aa1d-4096-aea9-c9cae1d15e03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:06.664556 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1729b4c3-4d8c-4641-8bb8-fd95e7b1ce0a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:06.665253 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2e906618-aa1d-4096-aea9-c9cae1d15e03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:06.665838 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2e906618-aa1d-4096-aea9-c9cae1d15e03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:06.666358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2e906618-aa1d-4096-aea9-c9cae1d15e03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:06.870156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2e906618-aa1d-4096-aea9-c9cae1d15e03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:06.885075 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2e906618-aa1d-4096-aea9-c9cae1d15e03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:06.887082 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2e906618-aa1d-4096-aea9-c9cae1d15e03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:06.888760 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2e906618-aa1d-4096-aea9-c9cae1d15e03 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.243147 Aug 08 16:58:06.889499 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 400/810] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:58:06 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:58:06.902837 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1729b4c3-4d8c-4641-8bb8-fd95e7b1ce0a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:06.903280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-43ec4365-9cb2-4525-93fc-f2aac1b93fdc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:06.903280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-43ec4365-9cb2-4525-93fc-f2aac1b93fdc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:06.903555 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1729b4c3-4d8c-4641-8bb8-fd95e7b1ce0a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1367 microversion: 2.1 time: 0.260244 Aug 08 16:58:06.903555 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 411/811] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:06 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:06.913332 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43ec4365-9cb2-4525-93fc-f2aac1b93fdc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:06.914039 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43ec4365-9cb2-4525-93fc-f2aac1b93fdc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:06.914555 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43ec4365-9cb2-4525-93fc-f2aac1b93fdc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:06.915539 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43ec4365-9cb2-4525-93fc-f2aac1b93fdc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:06.916106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43ec4365-9cb2-4525-93fc-f2aac1b93fdc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:06.926432 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43ec4365-9cb2-4525-93fc-f2aac1b93fdc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:06.990081 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f0340a92-00e6-440b-acd6-1bfae4b38b30 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:06.990081 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f0340a92-00e6-440b-acd6-1bfae4b38b30 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:06.997196 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f0340a92-00e6-440b-acd6-1bfae4b38b30 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:06.997698 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f0340a92-00e6-440b-acd6-1bfae4b38b30 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:06.998896 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f0340a92-00e6-440b-acd6-1bfae4b38b30 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:06.999697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f0340a92-00e6-440b-acd6-1bfae4b38b30 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:07.000229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f0340a92-00e6-440b-acd6-1bfae4b38b30 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:07.000689 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f0340a92-00e6-440b-acd6-1bfae4b38b30 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:07.116311 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-43ec4365-9cb2-4525-93fc-f2aac1b93fdc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:07.127072 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-43ec4365-9cb2-4525-93fc-f2aac1b93fdc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.234956 Aug 08 16:58:07.128017 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 401/812] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:06 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:07.220824 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f0340a92-00e6-440b-acd6-1bfae4b38b30 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:07.230912 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f0340a92-00e6-440b-acd6-1bfae4b38b30 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1724 microversion: 2.1 time: 0.245169 Aug 08 16:58:07.230912 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 412/813] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:06 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:07.732419 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-a39ce8cd-e00f-46e9-8dde-4572c2c5481a req-5f5939d5-ab1e-4ce7-b57e-36070ea43038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70c7402-29f3-48b0-b5fc-dd586f6e4266", "name": "network-vif-plugged", "status": "completed", "tag": "ee6f4872-65bc-467b-9551-24824a3b32ad"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:07.743628 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-a39ce8cd-e00f-46e9-8dde-4572c2c5481a req-5f5939d5-ab1e-4ce7-b57e-36070ea43038 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:07.744123 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-a39ce8cd-e00f-46e9-8dde-4572c2c5481a req-5f5939d5-ab1e-4ce7-b57e-36070ea43038 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:07.744566 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-a39ce8cd-e00f-46e9-8dde-4572c2c5481a req-5f5939d5-ab1e-4ce7-b57e-36070ea43038 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:07.760363 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-a39ce8cd-e00f-46e9-8dde-4572c2c5481a req-5f5939d5-ab1e-4ce7-b57e-36070ea43038 service nova] Creating event network-vif-plugged:ee6f4872-65bc-467b-9551-24824a3b32ad for instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 on hv-cinder-85220 Aug 08 16:58:07.768436 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-a39ce8cd-e00f-46e9-8dde-4572c2c5481a req-5f5939d5-ab1e-4ce7-b57e-36070ea43038 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110837 Aug 08 16:58:07.769724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 402/814] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:07.930940 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-63e70d07-c282-4cda-b27c-cfd566ea1f0b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:07.933693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-63e70d07-c282-4cda-b27c-cfd566ea1f0b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:07.945971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-963be0a2-e544-4cab-83c5-1079c3574898 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:07.947001 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-963be0a2-e544-4cab-83c5-1079c3574898 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:07.948912 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63e70d07-c282-4cda-b27c-cfd566ea1f0b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:07.950260 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63e70d07-c282-4cda-b27c-cfd566ea1f0b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:07.951143 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63e70d07-c282-4cda-b27c-cfd566ea1f0b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:07.952598 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63e70d07-c282-4cda-b27c-cfd566ea1f0b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:07.953424 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63e70d07-c282-4cda-b27c-cfd566ea1f0b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:07.954230 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-63e70d07-c282-4cda-b27c-cfd566ea1f0b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:07.956410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-963be0a2-e544-4cab-83c5-1079c3574898 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:07.957243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-963be0a2-e544-4cab-83c5-1079c3574898 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:07.958206 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-963be0a2-e544-4cab-83c5-1079c3574898 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:07.961088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-963be0a2-e544-4cab-83c5-1079c3574898 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:07.962000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-963be0a2-e544-4cab-83c5-1079c3574898 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:07.962733 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-963be0a2-e544-4cab-83c5-1079c3574898 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:08.183300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-63e70d07-c282-4cda-b27c-cfd566ea1f0b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:08.195117 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-63e70d07-c282-4cda-b27c-cfd566ea1f0b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:08.198139 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-63e70d07-c282-4cda-b27c-cfd566ea1f0b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:08.200654 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-63e70d07-c282-4cda-b27c-cfd566ea1f0b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.278392 Aug 08 16:58:08.201590 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 413/815] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:58:07 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:58:08.207952 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e155ba30-d92d-4c2b-bd55-b58fee6591dc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:08.209074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e155ba30-d92d-4c2b-bd55-b58fee6591dc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:08.217685 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e155ba30-d92d-4c2b-bd55-b58fee6591dc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:08.218181 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e155ba30-d92d-4c2b-bd55-b58fee6591dc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:08.218812 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e155ba30-d92d-4c2b-bd55-b58fee6591dc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:08.219525 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e155ba30-d92d-4c2b-bd55-b58fee6591dc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:08.219983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e155ba30-d92d-4c2b-bd55-b58fee6591dc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:08.220407 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e155ba30-d92d-4c2b-bd55-b58fee6591dc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:08.259323 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-963be0a2-e544-4cab-83c5-1079c3574898 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:08.275042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-963be0a2-e544-4cab-83c5-1079c3574898 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1367 microversion: 2.1 time: 0.335453 Aug 08 16:58:08.276040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 403/816] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:07 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:08.282025 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6cf0defa-87e3-4b11-93f7-ea5e8664e3ff tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:08.282839 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6cf0defa-87e3-4b11-93f7-ea5e8664e3ff tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:08.291106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6cf0defa-87e3-4b11-93f7-ea5e8664e3ff tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:08.291746 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6cf0defa-87e3-4b11-93f7-ea5e8664e3ff tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:08.292370 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6cf0defa-87e3-4b11-93f7-ea5e8664e3ff tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:08.293243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6cf0defa-87e3-4b11-93f7-ea5e8664e3ff tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:08.294217 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6cf0defa-87e3-4b11-93f7-ea5e8664e3ff tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:08.295052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6cf0defa-87e3-4b11-93f7-ea5e8664e3ff tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:08.514999 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-6cf0defa-87e3-4b11-93f7-ea5e8664e3ff tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:08.532301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e155ba30-d92d-4c2b-bd55-b58fee6591dc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:08.534221 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-6cf0defa-87e3-4b11-93f7-ea5e8664e3ff tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1730 microversion: 2.1 time: 0.256559 Aug 08 16:58:08.536878 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 404/817] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:08 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:08.545859 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e155ba30-d92d-4c2b-bd55-b58fee6591dc tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.341979 Aug 08 16:58:08.546831 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 414/818] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:08 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:08.580412 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-705bc743-0bcc-4320-b73b-bbe40a404411 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:08.581273 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-705bc743-0bcc-4320-b73b-bbe40a404411 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:08.589004 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-705bc743-0bcc-4320-b73b-bbe40a404411 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:08.589873 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-705bc743-0bcc-4320-b73b-bbe40a404411 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:08.590754 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-705bc743-0bcc-4320-b73b-bbe40a404411 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:08.592419 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-705bc743-0bcc-4320-b73b-bbe40a404411 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:08.593084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-705bc743-0bcc-4320-b73b-bbe40a404411 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:08.593680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-705bc743-0bcc-4320-b73b-bbe40a404411 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:08.755643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-705bc743-0bcc-4320-b73b-bbe40a404411 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.184790 Aug 08 16:58:08.756688 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 405/819] 10.222.0.13 () {58 vars in 1275 bytes} [Mon Aug 8 16:58:08 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:09.226958 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-121510a4-4bac-490c-8413-d7723f1a515d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:09.227801 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-121510a4-4bac-490c-8413-d7723f1a515d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:09.236704 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-121510a4-4bac-490c-8413-d7723f1a515d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:09.237075 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-121510a4-4bac-490c-8413-d7723f1a515d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:09.237386 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-121510a4-4bac-490c-8413-d7723f1a515d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:09.238115 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-121510a4-4bac-490c-8413-d7723f1a515d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:09.238600 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-121510a4-4bac-490c-8413-d7723f1a515d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:09.239035 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-121510a4-4bac-490c-8413-d7723f1a515d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:09.305687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8db2827d-5e4e-427c-a9eb-e91fae3d3511 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:09.306325 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8db2827d-5e4e-427c-a9eb-e91fae3d3511 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:09.315906 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8db2827d-5e4e-427c-a9eb-e91fae3d3511 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:09.316833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8db2827d-5e4e-427c-a9eb-e91fae3d3511 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:09.317282 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8db2827d-5e4e-427c-a9eb-e91fae3d3511 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:09.317910 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8db2827d-5e4e-427c-a9eb-e91fae3d3511 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:09.318385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8db2827d-5e4e-427c-a9eb-e91fae3d3511 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:09.319746 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8db2827d-5e4e-427c-a9eb-e91fae3d3511 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:09.439058 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-121510a4-4bac-490c-8413-d7723f1a515d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:09.450795 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-121510a4-4bac-490c-8413-d7723f1a515d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:09.452879 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-121510a4-4bac-490c-8413-d7723f1a515d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:09.454387 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-121510a4-4bac-490c-8413-d7723f1a515d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.232275 Aug 08 16:58:09.455166 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 415/820] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:58:09 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:58:09.587251 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ed0d4dde-cc09-4cbd-b1fc-adcfc60aac40 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:09.587251 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ed0d4dde-cc09-4cbd-b1fc-adcfc60aac40 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:09.597172 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ed0d4dde-cc09-4cbd-b1fc-adcfc60aac40 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:09.598644 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ed0d4dde-cc09-4cbd-b1fc-adcfc60aac40 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:09.599887 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ed0d4dde-cc09-4cbd-b1fc-adcfc60aac40 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:09.601460 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ed0d4dde-cc09-4cbd-b1fc-adcfc60aac40 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:09.602904 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ed0d4dde-cc09-4cbd-b1fc-adcfc60aac40 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:09.603377 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ed0d4dde-cc09-4cbd-b1fc-adcfc60aac40 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:09.896105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ed0d4dde-cc09-4cbd-b1fc-adcfc60aac40 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:09.913118 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ed0d4dde-cc09-4cbd-b1fc-adcfc60aac40 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.340134 Aug 08 16:58:09.944814 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 416/821] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:09 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:10.036044 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8db2827d-5e4e-427c-a9eb-e91fae3d3511 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:10.045130 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8db2827d-5e4e-427c-a9eb-e91fae3d3511 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1367 microversion: 2.1 time: 0.744087 Aug 08 16:58:10.045916 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 406/822] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:09 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1367 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:10.481057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-bf899550-cde6-4713-8939-2a38dc860e9b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:10.483440 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-bf899550-cde6-4713-8939-2a38dc860e9b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:10.493558 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf899550-cde6-4713-8939-2a38dc860e9b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:10.494055 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf899550-cde6-4713-8939-2a38dc860e9b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:10.494494 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf899550-cde6-4713-8939-2a38dc860e9b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:10.495484 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf899550-cde6-4713-8939-2a38dc860e9b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:10.495942 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf899550-cde6-4713-8939-2a38dc860e9b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:10.496371 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bf899550-cde6-4713-8939-2a38dc860e9b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:10.696676 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bf899550-cde6-4713-8939-2a38dc860e9b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:10.706844 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bf899550-cde6-4713-8939-2a38dc860e9b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:10.709184 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bf899550-cde6-4713-8939-2a38dc860e9b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:10.711369 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-bf899550-cde6-4713-8939-2a38dc860e9b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.234360 Aug 08 16:58:10.712149 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 417/823] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:58:10 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:58:10.958661 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c4e0adbd-64f7-4461-9a22-32a70453d709 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:10.965779 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c4e0adbd-64f7-4461-9a22-32a70453d709 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:10.979773 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4e0adbd-64f7-4461-9a22-32a70453d709 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:10.980997 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4e0adbd-64f7-4461-9a22-32a70453d709 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:10.982238 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4e0adbd-64f7-4461-9a22-32a70453d709 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:10.983834 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4e0adbd-64f7-4461-9a22-32a70453d709 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:10.984906 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4e0adbd-64f7-4461-9a22-32a70453d709 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:10.986062 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4e0adbd-64f7-4461-9a22-32a70453d709 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:11.038372 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:11.079224 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b1c61bea-e95b-4a2d-b7d1-cd0f900903c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:11.082297 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b1c61bea-e95b-4a2d-b7d1-cd0f900903c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:11.098762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b1c61bea-e95b-4a2d-b7d1-cd0f900903c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:11.099589 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b1c61bea-e95b-4a2d-b7d1-cd0f900903c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:11.101043 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b1c61bea-e95b-4a2d-b7d1-cd0f900903c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:11.103115 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b1c61bea-e95b-4a2d-b7d1-cd0f900903c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:11.103960 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b1c61bea-e95b-4a2d-b7d1-cd0f900903c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:11.104945 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b1c61bea-e95b-4a2d-b7d1-cd0f900903c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:11.397909 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c4e0adbd-64f7-4461-9a22-32a70453d709 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:11.432983 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c4e0adbd-64f7-4461-9a22-32a70453d709 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.482681 Aug 08 16:58:11.434495 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 407/824] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:10 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:11.461120 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-98b4502f-ad9f-4734-9b1e-7a309aa12ed1 req-cf71f568-d0f2-4d31-a3fa-3b9d96095042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af731dd6-88e0-49bd-b38b-3b629bf771bb", "tag": "9c64ef7c-063c-4f76-93a2-991e5526c905"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:11.507622 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b1c61bea-e95b-4a2d-b7d1-cd0f900903c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:11.518480 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b1c61bea-e95b-4a2d-b7d1-cd0f900903c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1367 microversion: 2.1 time: 0.453135 Aug 08 16:58:11.519260 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 418/825] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:11 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:11.520856 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-98b4502f-ad9f-4734-9b1e-7a309aa12ed1 req-cf71f568-d0f2-4d31-a3fa-3b9d96095042 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:11.524444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-98b4502f-ad9f-4734-9b1e-7a309aa12ed1 req-cf71f568-d0f2-4d31-a3fa-3b9d96095042 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:11.525737 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-98b4502f-ad9f-4734-9b1e-7a309aa12ed1 req-cf71f568-d0f2-4d31-a3fa-3b9d96095042 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:11.561968 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-98b4502f-ad9f-4734-9b1e-7a309aa12ed1 req-cf71f568-d0f2-4d31-a3fa-3b9d96095042 service nova] Creating event network-changed:9c64ef7c-063c-4f76-93a2-991e5526c905 for instance af731dd6-88e0-49bd-b38b-3b629bf771bb on hv-cinder-85220 Aug 08 16:58:11.569477 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-98b4502f-ad9f-4734-9b1e-7a309aa12ed1 req-cf71f568-d0f2-4d31-a3fa-3b9d96095042 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132969 Aug 08 16:58:11.570383 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 408/826] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:11.764881 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0598da53-a269-491e-83a1-daac2754c5bb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:11.768659 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0598da53-a269-491e-83a1-daac2754c5bb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:11.798019 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0598da53-a269-491e-83a1-daac2754c5bb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:11.813435 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0598da53-a269-491e-83a1-daac2754c5bb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:11.814941 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0598da53-a269-491e-83a1-daac2754c5bb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:11.824783 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0598da53-a269-491e-83a1-daac2754c5bb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:11.832285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0598da53-a269-491e-83a1-daac2754c5bb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:11.840148 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0598da53-a269-491e-83a1-daac2754c5bb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:12.063324 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0598da53-a269-491e-83a1-daac2754c5bb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:12.077013 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0598da53-a269-491e-83a1-daac2754c5bb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:12.079889 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0598da53-a269-491e-83a1-daac2754c5bb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:12.082554 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0598da53-a269-491e-83a1-daac2754c5bb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.335146 Aug 08 16:58:12.084167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 419/827] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:58:11 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:58:12.482670 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f52bcb33-936a-4bab-bdf5-c9d8779de0fb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:12.484209 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f52bcb33-936a-4bab-bdf5-c9d8779de0fb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:12.496703 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f52bcb33-936a-4bab-bdf5-c9d8779de0fb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:12.497712 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f52bcb33-936a-4bab-bdf5-c9d8779de0fb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:12.499355 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f52bcb33-936a-4bab-bdf5-c9d8779de0fb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:12.500958 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f52bcb33-936a-4bab-bdf5-c9d8779de0fb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:12.502156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f52bcb33-936a-4bab-bdf5-c9d8779de0fb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:12.503145 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f52bcb33-936a-4bab-bdf5-c9d8779de0fb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:12.511032 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-7067578e-2e20-43ad-a711-4b88438b0058 req-bed9ce98-9814-4a9e-a5b4-34e0eb603a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d228b747-dc71-4145-bc09-820362dc7fc3", "name": "network-vif-plugged", "status": "completed", "tag": "0679f117-d099-44e2-88f2-6601e3adbc88"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:12.523873 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-7067578e-2e20-43ad-a711-4b88438b0058 req-bed9ce98-9814-4a9e-a5b4-34e0eb603a3b service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:12.523873 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-7067578e-2e20-43ad-a711-4b88438b0058 req-bed9ce98-9814-4a9e-a5b4-34e0eb603a3b service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:12.523873 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-7067578e-2e20-43ad-a711-4b88438b0058 req-bed9ce98-9814-4a9e-a5b4-34e0eb603a3b service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:12.537573 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-7067578e-2e20-43ad-a711-4b88438b0058 req-bed9ce98-9814-4a9e-a5b4-34e0eb603a3b service nova] Creating event network-vif-plugged:0679f117-d099-44e2-88f2-6601e3adbc88 for instance d228b747-dc71-4145-bc09-820362dc7fc3 on hv-cinder-85220 Aug 08 16:58:12.549218 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-7067578e-2e20-43ad-a711-4b88438b0058 req-bed9ce98-9814-4a9e-a5b4-34e0eb603a3b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041745 Aug 08 16:58:12.553391 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 420/828] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:58:12.557716 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9360f4d8-4ccf-4699-9476-2d084cba0e3e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:12.558908 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9360f4d8-4ccf-4699-9476-2d084cba0e3e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:12.567137 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9360f4d8-4ccf-4699-9476-2d084cba0e3e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:12.567793 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9360f4d8-4ccf-4699-9476-2d084cba0e3e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:12.568536 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9360f4d8-4ccf-4699-9476-2d084cba0e3e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:12.570162 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9360f4d8-4ccf-4699-9476-2d084cba0e3e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:12.570338 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9360f4d8-4ccf-4699-9476-2d084cba0e3e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:12.570736 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9360f4d8-4ccf-4699-9476-2d084cba0e3e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:12.867837 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9360f4d8-4ccf-4699-9476-2d084cba0e3e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:12.897377 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9360f4d8-4ccf-4699-9476-2d084cba0e3e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1367 microversion: 2.1 time: 0.341483 Aug 08 16:58:12.898614 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 421/829] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:12 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:13.027848 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f52bcb33-936a-4bab-bdf5-c9d8779de0fb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:13.044237 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f52bcb33-936a-4bab-bdf5-c9d8779de0fb tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.578238 Aug 08 16:58:13.047735 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 409/830] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:12 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:13.136738 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-683a97a8-cf6f-4790-a7c4-50a536fae27f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:13.138784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-683a97a8-cf6f-4790-a7c4-50a536fae27f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:13.151466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-683a97a8-cf6f-4790-a7c4-50a536fae27f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:13.152711 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-683a97a8-cf6f-4790-a7c4-50a536fae27f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:13.153746 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-683a97a8-cf6f-4790-a7c4-50a536fae27f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:13.155412 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-683a97a8-cf6f-4790-a7c4-50a536fae27f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:13.156703 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-683a97a8-cf6f-4790-a7c4-50a536fae27f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:13.157963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-683a97a8-cf6f-4790-a7c4-50a536fae27f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:13.550469 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-683a97a8-cf6f-4790-a7c4-50a536fae27f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:13.556001 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=100 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:13.566169 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-683a97a8-cf6f-4790-a7c4-50a536fae27f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:13.569435 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-683a97a8-cf6f-4790-a7c4-50a536fae27f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:13.570701 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-683a97a8-cf6f-4790-a7c4-50a536fae27f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1808 microversion: 2.20 time: 0.450690 Aug 08 16:58:13.571398 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 422/831] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:58:13 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1808 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:58:13.601901 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-a105361b-2111-4550-8de5-e804d1bf33b6 req-c3ccc76f-dfe2-4253-9971-4d38fcbdde17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af731dd6-88e0-49bd-b38b-3b629bf771bb", "tag": "9c64ef7c-063c-4f76-93a2-991e5526c905"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:13.620928 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-a105361b-2111-4550-8de5-e804d1bf33b6 req-c3ccc76f-dfe2-4253-9971-4d38fcbdde17 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:13.622103 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-a105361b-2111-4550-8de5-e804d1bf33b6 req-c3ccc76f-dfe2-4253-9971-4d38fcbdde17 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:13.623353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-a105361b-2111-4550-8de5-e804d1bf33b6 req-c3ccc76f-dfe2-4253-9971-4d38fcbdde17 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:13.643342 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-a105361b-2111-4550-8de5-e804d1bf33b6 req-c3ccc76f-dfe2-4253-9971-4d38fcbdde17 service nova] Creating event network-changed:9c64ef7c-063c-4f76-93a2-991e5526c905 for instance af731dd6-88e0-49bd-b38b-3b629bf771bb on hv-cinder-85220 Aug 08 16:58:13.651990 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-a105361b-2111-4550-8de5-e804d1bf33b6 req-c3ccc76f-dfe2-4253-9971-4d38fcbdde17 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057053 Aug 08 16:58:13.652928 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 410/832] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:13.942719 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-448fc4cf-3d54-42e3-9170-72a7867983c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:13.945497 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-448fc4cf-3d54-42e3-9170-72a7867983c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:13.952912 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-448fc4cf-3d54-42e3-9170-72a7867983c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:13.953771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-448fc4cf-3d54-42e3-9170-72a7867983c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:13.954556 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-448fc4cf-3d54-42e3-9170-72a7867983c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:13.957723 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-448fc4cf-3d54-42e3-9170-72a7867983c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:13.958963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-448fc4cf-3d54-42e3-9170-72a7867983c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:13.960728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-448fc4cf-3d54-42e3-9170-72a7867983c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:14.074368 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ac9207f6-8a05-483b-928a-6e583b3e8687 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:14.075153 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ac9207f6-8a05-483b-928a-6e583b3e8687 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:14.082411 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ac9207f6-8a05-483b-928a-6e583b3e8687 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:14.082951 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ac9207f6-8a05-483b-928a-6e583b3e8687 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:14.083397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ac9207f6-8a05-483b-928a-6e583b3e8687 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:14.084647 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ac9207f6-8a05-483b-928a-6e583b3e8687 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:14.085177 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ac9207f6-8a05-483b-928a-6e583b3e8687 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:14.085826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ac9207f6-8a05-483b-928a-6e583b3e8687 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:14.177506 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-448fc4cf-3d54-42e3-9170-72a7867983c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:14.195771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-448fc4cf-3d54-42e3-9170-72a7867983c1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1367 microversion: 2.1 time: 0.258260 Aug 08 16:58:14.196841 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 423/833] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:13 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:14.292275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ac9207f6-8a05-483b-928a-6e583b3e8687 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:14.306527 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ac9207f6-8a05-483b-928a-6e583b3e8687 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.236611 Aug 08 16:58:14.307159 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 411/834] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:14 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:14.596690 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9592e61f-dc6a-47d7-963a-f27b72bd3772 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:14.598308 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9592e61f-dc6a-47d7-963a-f27b72bd3772 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:14.608901 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9592e61f-dc6a-47d7-963a-f27b72bd3772 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:14.609699 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9592e61f-dc6a-47d7-963a-f27b72bd3772 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:14.610327 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9592e61f-dc6a-47d7-963a-f27b72bd3772 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:14.611674 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9592e61f-dc6a-47d7-963a-f27b72bd3772 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:14.612417 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9592e61f-dc6a-47d7-963a-f27b72bd3772 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:14.613068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9592e61f-dc6a-47d7-963a-f27b72bd3772 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:14.994739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9592e61f-dc6a-47d7-963a-f27b72bd3772 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:15.004576 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9592e61f-dc6a-47d7-963a-f27b72bd3772 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:15.006961 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9592e61f-dc6a-47d7-963a-f27b72bd3772 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:15.008210 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9592e61f-dc6a-47d7-963a-f27b72bd3772 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1795 microversion: 2.20 time: 0.416996 Aug 08 16:58:15.008790 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 424/835] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:58:14 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1795 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:58:15.234956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8b99dc2d-2b13-49ac-b56b-bf6c2cf445a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:15.236521 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8b99dc2d-2b13-49ac-b56b-bf6c2cf445a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:15.246970 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8b99dc2d-2b13-49ac-b56b-bf6c2cf445a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:15.247724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8b99dc2d-2b13-49ac-b56b-bf6c2cf445a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:15.248278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8b99dc2d-2b13-49ac-b56b-bf6c2cf445a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:15.249105 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8b99dc2d-2b13-49ac-b56b-bf6c2cf445a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:15.249692 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8b99dc2d-2b13-49ac-b56b-bf6c2cf445a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:15.250250 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8b99dc2d-2b13-49ac-b56b-bf6c2cf445a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:15.335963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-586f1f04-8e38-46f4-a626-59523e85d8c4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:15.337410 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-586f1f04-8e38-46f4-a626-59523e85d8c4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:15.353151 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-586f1f04-8e38-46f4-a626-59523e85d8c4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:15.353978 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-586f1f04-8e38-46f4-a626-59523e85d8c4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:15.354664 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-586f1f04-8e38-46f4-a626-59523e85d8c4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:15.355714 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-586f1f04-8e38-46f4-a626-59523e85d8c4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:15.356533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-586f1f04-8e38-46f4-a626-59523e85d8c4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:15.357143 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-586f1f04-8e38-46f4-a626-59523e85d8c4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:15.520707 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8b99dc2d-2b13-49ac-b56b-bf6c2cf445a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:15.536145 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8b99dc2d-2b13-49ac-b56b-bf6c2cf445a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1367 microversion: 2.1 time: 0.306987 Aug 08 16:58:15.538296 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 412/836] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:15 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:15.896179 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-586f1f04-8e38-46f4-a626-59523e85d8c4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:15.937065 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-586f1f04-8e38-46f4-a626-59523e85d8c4 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.604956 Aug 08 16:58:15.938880 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 425/837] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:15 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:16.567524 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-42270386-189e-42ee-ba30-db916ef79a18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:16.569962 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-42270386-189e-42ee-ba30-db916ef79a18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:16.582996 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-42270386-189e-42ee-ba30-db916ef79a18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:16.584213 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-42270386-189e-42ee-ba30-db916ef79a18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:16.584634 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-42270386-189e-42ee-ba30-db916ef79a18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:16.585572 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-42270386-189e-42ee-ba30-db916ef79a18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:16.586193 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-42270386-189e-42ee-ba30-db916ef79a18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:16.586924 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-42270386-189e-42ee-ba30-db916ef79a18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:16.822117 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-42270386-189e-42ee-ba30-db916ef79a18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:16.837192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-42270386-189e-42ee-ba30-db916ef79a18 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1556 microversion: 2.1 time: 0.274996 Aug 08 16:58:16.839178 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 413/838] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:16 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1556 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:16.886673 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c2865d91-24c3-4aee-89ba-da40e83701ac tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:16.889209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c2865d91-24c3-4aee-89ba-da40e83701ac tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:16.902845 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c2865d91-24c3-4aee-89ba-da40e83701ac tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:16.905374 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c2865d91-24c3-4aee-89ba-da40e83701ac tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:16.906968 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c2865d91-24c3-4aee-89ba-da40e83701ac tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:16.908895 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c2865d91-24c3-4aee-89ba-da40e83701ac tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:16.911342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c2865d91-24c3-4aee-89ba-da40e83701ac tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:16.913040 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c2865d91-24c3-4aee-89ba-da40e83701ac tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:16.974275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fa3e3987-964a-4ac8-a1dc-16e5dd6fec5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:16.989300 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fa3e3987-964a-4ac8-a1dc-16e5dd6fec5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:17.019586 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa3e3987-964a-4ac8-a1dc-16e5dd6fec5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:17.023161 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa3e3987-964a-4ac8-a1dc-16e5dd6fec5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:17.023727 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa3e3987-964a-4ac8-a1dc-16e5dd6fec5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:17.025270 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa3e3987-964a-4ac8-a1dc-16e5dd6fec5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:17.026058 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa3e3987-964a-4ac8-a1dc-16e5dd6fec5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:17.027169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa3e3987-964a-4ac8-a1dc-16e5dd6fec5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:17.168471 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c2865d91-24c3-4aee-89ba-da40e83701ac tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.292192 Aug 08 16:58:17.170766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 426/839] 10.222.0.13 () {58 vars in 1275 bytes} [Mon Aug 8 16:58:16 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-interface => generated 285 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:17.594258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fa3e3987-964a-4ac8-a1dc-16e5dd6fec5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:17.613252 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fa3e3987-964a-4ac8-a1dc-16e5dd6fec5d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.652586 Aug 08 16:58:17.614335 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 414/840] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:16 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:18.650476 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-235854c7-79fa-44cd-b7e9-23fc5e36087b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:18.654096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-235854c7-79fa-44cd-b7e9-23fc5e36087b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:18.677043 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-235854c7-79fa-44cd-b7e9-23fc5e36087b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:18.678483 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-235854c7-79fa-44cd-b7e9-23fc5e36087b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:18.680460 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-235854c7-79fa-44cd-b7e9-23fc5e36087b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:18.682706 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-235854c7-79fa-44cd-b7e9-23fc5e36087b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:18.684850 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-235854c7-79fa-44cd-b7e9-23fc5e36087b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:18.686341 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-235854c7-79fa-44cd-b7e9-23fc5e36087b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:18.972112 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-235854c7-79fa-44cd-b7e9-23fc5e36087b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:18.985526 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-235854c7-79fa-44cd-b7e9-23fc5e36087b tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.349319 Aug 08 16:58:18.987340 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 427/841] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:18 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:19.364642 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-b77ddfbd-3240-45b5-9285-ed04a4b170d5 req-cd223098-5f74-49f4-8971-b6fda37fead3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d228b747-dc71-4145-bc09-820362dc7fc3", "tag": "0679f117-d099-44e2-88f2-6601e3adbc88"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:19.386274 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b77ddfbd-3240-45b5-9285-ed04a4b170d5 req-cd223098-5f74-49f4-8971-b6fda37fead3 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:19.387725 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b77ddfbd-3240-45b5-9285-ed04a4b170d5 req-cd223098-5f74-49f4-8971-b6fda37fead3 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:19.388544 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b77ddfbd-3240-45b5-9285-ed04a4b170d5 req-cd223098-5f74-49f4-8971-b6fda37fead3 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:19.405079 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-b77ddfbd-3240-45b5-9285-ed04a4b170d5 req-cd223098-5f74-49f4-8971-b6fda37fead3 service nova] Creating event network-changed:0679f117-d099-44e2-88f2-6601e3adbc88 for instance d228b747-dc71-4145-bc09-820362dc7fc3 on hv-cinder-85220 Aug 08 16:58:19.412478 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-b77ddfbd-3240-45b5-9285-ed04a4b170d5 req-cd223098-5f74-49f4-8971-b6fda37fead3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054186 Aug 08 16:58:19.414199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 415/842] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:20.036293 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c6230959-9ecc-4424-9d4e-48644f73d1c3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:20.039792 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c6230959-9ecc-4424-9d4e-48644f73d1c3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:20.054296 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c6230959-9ecc-4424-9d4e-48644f73d1c3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:20.054842 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c6230959-9ecc-4424-9d4e-48644f73d1c3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:20.055454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c6230959-9ecc-4424-9d4e-48644f73d1c3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:20.057157 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c6230959-9ecc-4424-9d4e-48644f73d1c3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:20.057656 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c6230959-9ecc-4424-9d4e-48644f73d1c3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:20.058089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c6230959-9ecc-4424-9d4e-48644f73d1c3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:20.369127 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c6230959-9ecc-4424-9d4e-48644f73d1c3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:20.381502 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c6230959-9ecc-4424-9d4e-48644f73d1c3 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1755 microversion: 2.1 time: 0.358797 Aug 08 16:58:20.382105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 428/843] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:20 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1755 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:21.410692 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c4d736ca-6e0e-4502-a804-33ae716439af tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:21.412977 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c4d736ca-6e0e-4502-a804-33ae716439af tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:21.429446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4d736ca-6e0e-4502-a804-33ae716439af tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:21.431377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4d736ca-6e0e-4502-a804-33ae716439af tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:21.432373 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4d736ca-6e0e-4502-a804-33ae716439af tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:21.434152 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4d736ca-6e0e-4502-a804-33ae716439af tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:21.436227 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4d736ca-6e0e-4502-a804-33ae716439af tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:21.437123 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c4d736ca-6e0e-4502-a804-33ae716439af tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:21.689108 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c4d736ca-6e0e-4502-a804-33ae716439af tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:21.705859 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c4d736ca-6e0e-4502-a804-33ae716439af tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1758 microversion: 2.1 time: 0.304259 Aug 08 16:58:21.714842 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 416/844] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:21 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1758 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:29.107319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6f7f07ba-d55e-4644-94e8-6146c6f41e8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:29.113874 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6f7f07ba-d55e-4644-94e8-6146c6f41e8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:29.117009 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=78 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:29.124335 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6f7f07ba-d55e-4644-94e8-6146c6f41e8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:29.125709 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6f7f07ba-d55e-4644-94e8-6146c6f41e8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:29.126158 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6f7f07ba-d55e-4644-94e8-6146c6f41e8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:29.126942 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6f7f07ba-d55e-4644-94e8-6146c6f41e8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:29.127409 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6f7f07ba-d55e-4644-94e8-6146c6f41e8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:29.127837 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6f7f07ba-d55e-4644-94e8-6146c6f41e8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:29.167817 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6f7f07ba-d55e-4644-94e8-6146c6f41e8b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064109 Aug 08 16:58:29.168893 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 429/845] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:58:29 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 16:58:29.277974 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-803b81f2-4dc2-42bf-b23b-42076fde9051 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:29.279190 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-803b81f2-4dc2-42bf-b23b-42076fde9051 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:29.286367 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-803b81f2-4dc2-42bf-b23b-42076fde9051 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:29.287418 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-803b81f2-4dc2-42bf-b23b-42076fde9051 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:29.287871 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-803b81f2-4dc2-42bf-b23b-42076fde9051 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:29.288615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-803b81f2-4dc2-42bf-b23b-42076fde9051 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:29.289317 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-803b81f2-4dc2-42bf-b23b-42076fde9051 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:29.289748 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-803b81f2-4dc2-42bf-b23b-42076fde9051 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:29.321892 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-803b81f2-4dc2-42bf-b23b-42076fde9051 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:58:29.401874 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-eadec633-6bae-4e08-bc2e-63b3a133b435 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Action: 'create', calling method: .version_select at 0x7f501615daf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1165660734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6LteGxX2/JUyJEk1D6Xru3SejEdaahnem94EfVabPY6isS+IkL9dANDfK/BICxqwF4CrZMCBi8ylGtOPZsPEk2ZZWhZth8OE9t51T+DLyKVyhARlyVGlkai6kyIoaOEA=="}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:29.419836 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-eadec633-6bae-4e08-bc2e-63b3a133b435 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Getting quotas for project 73ca0765d1fb44cda1c4c2562a695ac6. Resources: {'key_pairs'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:58:29.424319 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-eadec633-6bae-4e08-bc2e-63b3a133b435 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Getting quotas for user 803b15aebfb044c3893831f84f1aa1d7 and project 73ca0765d1fb44cda1c4c2562a695ac6. Resources: {'key_pairs'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:58:29.513671 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-eadec633-6bae-4e08-bc2e-63b3a133b435 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.359493 Aug 08 16:58:29.514349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 417/846] 10.222.0.13 () {60 vars in 1159 bytes} [Mon Aug 8 16:58:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:58:29.676754 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-803b81f2-4dc2-42bf-b23b-42076fde9051 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 204 len: 0 microversion: 2.1 time: 0.403741 Aug 08 16:58:29.678189 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 430/847] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:58:29 2022] DELETE /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 16:58:29.686910 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-624c08fa-c66a-4ead-9578-4272f0be56a7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:29.687537 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-624c08fa-c66a-4ead-9578-4272f0be56a7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:29.695272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-624c08fa-c66a-4ead-9578-4272f0be56a7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:29.695768 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-624c08fa-c66a-4ead-9578-4272f0be56a7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:29.696215 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-624c08fa-c66a-4ead-9578-4272f0be56a7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:29.696930 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-624c08fa-c66a-4ead-9578-4272f0be56a7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:29.697389 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-624c08fa-c66a-4ead-9578-4272f0be56a7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:29.697809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-624c08fa-c66a-4ead-9578-4272f0be56a7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:29.939446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-624c08fa-c66a-4ead-9578-4272f0be56a7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:29.953692 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-624c08fa-c66a-4ead-9578-4272f0be56a7 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1674 microversion: 2.1 time: 0.270393 Aug 08 16:58:29.955279 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 418/848] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:29 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1674 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:30.986285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4770ea23-645f-41b9-af36-191eb28d14bf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:30.988047 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4770ea23-645f-41b9-af36-191eb28d14bf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:31.000729 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4770ea23-645f-41b9-af36-191eb28d14bf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:31.001624 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4770ea23-645f-41b9-af36-191eb28d14bf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:31.002408 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4770ea23-645f-41b9-af36-191eb28d14bf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:31.004082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4770ea23-645f-41b9-af36-191eb28d14bf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:31.004082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4770ea23-645f-41b9-af36-191eb28d14bf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:31.005700 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4770ea23-645f-41b9-af36-191eb28d14bf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:31.228180 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4770ea23-645f-41b9-af36-191eb28d14bf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:31.238989 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4770ea23-645f-41b9-af36-191eb28d14bf tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1674 microversion: 2.1 time: 0.260614 Aug 08 16:58:31.241210 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 431/849] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:30 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1674 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:32.277643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1530e5d5-3271-44ec-8af0-e6ea09a811da tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:32.279297 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1530e5d5-3271-44ec-8af0-e6ea09a811da tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:32.291396 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1530e5d5-3271-44ec-8af0-e6ea09a811da tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:32.292218 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1530e5d5-3271-44ec-8af0-e6ea09a811da tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:32.293234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1530e5d5-3271-44ec-8af0-e6ea09a811da tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:32.294092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1530e5d5-3271-44ec-8af0-e6ea09a811da tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:32.294944 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1530e5d5-3271-44ec-8af0-e6ea09a811da tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:32.295947 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1530e5d5-3271-44ec-8af0-e6ea09a811da tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:32.420219 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1530e5d5-3271-44ec-8af0-e6ea09a811da tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:32.439999 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1530e5d5-3271-44ec-8af0-e6ea09a811da tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1607 microversion: 2.1 time: 0.166507 Aug 08 16:58:32.441658 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 419/850] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:32 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1607 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:32.764430 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-2badb05f-f4a8-47a2-b865-67a6d81a650d req-8c657fb7-8692-43f5-9e00-8b8b30f21f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba167d3-4013-4e79-8c84-5a72b458b6f7", "name": "network-vif-deleted", "tag": "adc434bf-69d7-4da9-9eea-f961d0824299"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:32.789394 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-2badb05f-f4a8-47a2-b865-67a6d81a650d req-8c657fb7-8692-43f5-9e00-8b8b30f21f7f service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:32.789903 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-2badb05f-f4a8-47a2-b865-67a6d81a650d req-8c657fb7-8692-43f5-9e00-8b8b30f21f7f service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:32.790312 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-2badb05f-f4a8-47a2-b865-67a6d81a650d req-8c657fb7-8692-43f5-9e00-8b8b30f21f7f service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:32.811454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-2badb05f-f4a8-47a2-b865-67a6d81a650d req-8c657fb7-8692-43f5-9e00-8b8b30f21f7f service nova] Creating event network-vif-deleted:adc434bf-69d7-4da9-9eea-f961d0824299 for instance cba167d3-4013-4e79-8c84-5a72b458b6f7 on hv-cinder-85220 Aug 08 16:58:32.811454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-2badb05f-f4a8-47a2-b865-67a6d81a650d req-8c657fb7-8692-43f5-9e00-8b8b30f21f7f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047734 Aug 08 16:58:32.811454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 432/851] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:58:33.466773 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:33.468336 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:33.481070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:33.482347 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:33.484708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:33.486546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:33.487614 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:33.488629 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:33.557251 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:33.558239 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:33.559599 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:33.560531 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lazy-loading 'fault' on Instance uuid cba167d3-4013-4e79-8c84-5a72b458b6f7 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:58:33.649573 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:33.659689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-eebb7b9b-d3fe-4b84-bf87-18582b5700df tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 200 len: 1328 microversion: 2.1 time: 0.198757 Aug 08 16:58:33.660668 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 420/852] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:33 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 1328 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:34.687232 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-76f8ebb8-e305-4497-8fb3-6bb7e2671327 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:34.688492 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-76f8ebb8-e305-4497-8fb3-6bb7e2671327 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:34.699463 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76f8ebb8-e305-4497-8fb3-6bb7e2671327 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:34.700113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76f8ebb8-e305-4497-8fb3-6bb7e2671327 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:34.700732 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76f8ebb8-e305-4497-8fb3-6bb7e2671327 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:34.701662 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76f8ebb8-e305-4497-8fb3-6bb7e2671327 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:34.702156 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76f8ebb8-e305-4497-8fb3-6bb7e2671327 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:34.702623 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76f8ebb8-e305-4497-8fb3-6bb7e2671327 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:34.719493 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-76f8ebb8-e305-4497-8fb3-6bb7e2671327 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] HTTP exception thrown: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-76f8ebb8-e305-4497-8fb3-6bb7e2671327 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Request method failure captured: Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 HTTP/1.1 Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T8zz_sgph4OjkDyJGqkA_trzNf4cb7yev6uDvojpLSHACfewopQryGVE08Kw7YWSILrSxZpfVZvLWEyk3LzhXmMTPcSIfU1xHfTP-zmkvwMoMD8vXKvQ-QcKBJ-kgZXoJQluZSKugBhKtqoKdUfqq1g5o2Uzb9J20aQdhDkfeSgKXI Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: 442f2ca88fce4cbab9c01278239b77ce Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-AttachVolumeTestJSON-1057712121 Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 16:58:34.721209 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 16:58:34.724343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_442f2ca88fce4cbab9c01278239b77ce", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:58:34.724343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-AttachVolumeTestJSON-1057712121 Aug 08 16:58:34.724343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: 442f2ca88fce4cbab9c01278239b77ce Aug 08 16:58:34.724343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1057712121 Aug 08 16:58:34.724343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-AttachVolumeTestJSON-1057712121-project Aug 08 16:58:34.724343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 16:58:34.724343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 16:58:34.724343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: 5a8db3ff64ca44958fd633ba25ee191f Aug 08 16:58:34.724343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-AttachVolumeTestJSON-1057712121-project Aug 08 16:58:34.724343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 16:58:34.724343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 16:58:34.724343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': 'cba167d3-4013-4e79-8c84-5a72b458b6f7'} Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:58:34.726229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 16:58:34.729316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:58:34.732205 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-76f8ebb8-e305-4497-8fb3-6bb7e2671327 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Returning 404 to user: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:58:34.732205 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-76f8ebb8-e305-4497-8fb3-6bb7e2671327 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 404 len: 111 microversion: 2.1 time: 0.042928 Aug 08 16:58:34.732205 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 433/853] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:34 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:58:34.736091 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9fb07ac9-3b57-45a7-be2a-cdeeef76a969 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '.version_select at 0x7f5015fa9ca0>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:34.827867 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9fb07ac9-3b57-45a7-be2a-cdeeef76a969 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704036561" status: 202 len: 0 microversion: 2.1 time: 0.097001 Aug 08 16:58:34.828681 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 421/854] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Aug 8 16:58:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704036561 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:58:36.019920 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fd6dd775-7be0-470b-8400-b59a4dfbde52 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Action: 'create', calling method: .version_select at 0x7f501a93b0d0>, body: {"keypair": {"name": "tempest-keypair-282007553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO209XUmOetdA0pDIvWw+ZMWpEssKRV9RAhEeMGQwEoSgKcxKXxfZ3fOpANTbjX/d6rGVUBVPxtFwUHQdsYeSjYC60vyZkkBkEdrSTMfZsKIF1ZAFjbZyjid0q+DkGEtqg=="}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:36.039283 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-fd6dd775-7be0-470b-8400-b59a4dfbde52 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Getting quotas for project 442f2ca88fce4cbab9c01278239b77ce. Resources: {'key_pairs'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:58:36.044162 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-fd6dd775-7be0-470b-8400-b59a4dfbde52 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Getting quotas for user 5a8db3ff64ca44958fd633ba25ee191f and project 442f2ca88fce4cbab9c01278239b77ce. Resources: {'key_pairs'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:58:36.183079 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fd6dd775-7be0-470b-8400-b59a4dfbde52 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.166730 Aug 08 16:58:36.183851 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 434/855] 10.222.0.13 () {60 vars in 1159 bytes} [Mon Aug 8 16:58:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:58:39.241866 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-937791662", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "666863c6-3645-478a-b5a7-f526e7cb7a76"}], "security_groups": [{"name": "tempest-securitygroup--23937469"}], "key_name": "tempest-keypair-282007553", "user_data": "}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:39.251313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:39.372144 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.network.neutron [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] validate_networks() for [('666863c6-3645-478a-b5a7-f526e7cb7a76', None, None, None, None, None)] {{(pid=130235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:58:39.432197 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=4 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:40.115153 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Flavor limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:58:40.115941 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Image limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:58:40.116845 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Flavor pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:58:40.117579 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Image pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:58:40.118554 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:58:40.137014 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:40.137820 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:40.138631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:40.140002 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:40.140809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:40.141559 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:40.174955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Getting quotas for project 442f2ca88fce4cbab9c01278239b77ce. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:58:40.183756 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Getting quotas for user 5a8db3ff64ca44958fd633ba25ee191f and project 442f2ca88fce4cbab9c01278239b77ce. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:58:40.207703 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Going to run 1 instances... {{(pid=130235) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:58:40.212715 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:58:40.526426 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-907aa0ef-d426-45d4-abe9-646c230aabe6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.290883 Aug 08 16:58:40.527655 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 422/856] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:58:39 2022] POST /compute/v2.1/servers => generated 400 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 16:58:40.545718 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-da75db82-228d-4c10-bbad-fd25d3840f1c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:40.546814 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-da75db82-228d-4c10-bbad-fd25d3840f1c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:40.638476 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-da75db82-228d-4c10-bbad-fd25d3840f1c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:40.649984 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-da75db82-228d-4c10-bbad-fd25d3840f1c tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1236 microversion: 2.1 time: 0.109117 Aug 08 16:58:40.651002 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 435/857] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:40 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1236 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:41.678060 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9e65ffbf-cd5e-4047-82b2-a5c2216b3088 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:41.679325 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9e65ffbf-cd5e-4047-82b2-a5c2216b3088 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:41.689931 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9e65ffbf-cd5e-4047-82b2-a5c2216b3088 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:41.693631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9e65ffbf-cd5e-4047-82b2-a5c2216b3088 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:41.693631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9e65ffbf-cd5e-4047-82b2-a5c2216b3088 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:41.693631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9e65ffbf-cd5e-4047-82b2-a5c2216b3088 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:41.693631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9e65ffbf-cd5e-4047-82b2-a5c2216b3088 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:41.694273 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9e65ffbf-cd5e-4047-82b2-a5c2216b3088 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:41.697278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=70 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:41.772745 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9e65ffbf-cd5e-4047-82b2-a5c2216b3088 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:41.781107 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9e65ffbf-cd5e-4047-82b2-a5c2216b3088 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1240 microversion: 2.1 time: 0.109154 Aug 08 16:58:41.781818 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 423/858] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:41 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:42.806975 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d75a3460-0e60-41b6-a7ac-be6f9d1b79d4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:42.808383 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d75a3460-0e60-41b6-a7ac-be6f9d1b79d4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:42.816391 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d75a3460-0e60-41b6-a7ac-be6f9d1b79d4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:42.817563 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d75a3460-0e60-41b6-a7ac-be6f9d1b79d4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:42.818110 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d75a3460-0e60-41b6-a7ac-be6f9d1b79d4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:42.819286 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d75a3460-0e60-41b6-a7ac-be6f9d1b79d4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:42.819845 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d75a3460-0e60-41b6-a7ac-be6f9d1b79d4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:42.820421 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d75a3460-0e60-41b6-a7ac-be6f9d1b79d4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:42.894723 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d75a3460-0e60-41b6-a7ac-be6f9d1b79d4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:42.903816 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d75a3460-0e60-41b6-a7ac-be6f9d1b79d4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1288 microversion: 2.1 time: 0.104269 Aug 08 16:58:42.904406 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 436/859] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:42 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1288 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:43.943882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-71ace987-5ca2-4957-a3b3-7cd7486829e2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:43.944928 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-71ace987-5ca2-4957-a3b3-7cd7486829e2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:43.954391 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-71ace987-5ca2-4957-a3b3-7cd7486829e2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:43.955062 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-71ace987-5ca2-4957-a3b3-7cd7486829e2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:43.955599 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-71ace987-5ca2-4957-a3b3-7cd7486829e2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:43.956741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-71ace987-5ca2-4957-a3b3-7cd7486829e2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:43.958366 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-71ace987-5ca2-4957-a3b3-7cd7486829e2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:43.958935 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-71ace987-5ca2-4957-a3b3-7cd7486829e2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:44.055128 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-71ace987-5ca2-4957-a3b3-7cd7486829e2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:44.064266 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-71ace987-5ca2-4957-a3b3-7cd7486829e2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1294 microversion: 2.1 time: 0.129314 Aug 08 16:58:44.076163 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 424/860] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:43 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1294 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:45.089108 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-04c07e28-50d4-4ee0-975e-164335c96f29 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:45.089719 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-04c07e28-50d4-4ee0-975e-164335c96f29 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:45.101099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-04c07e28-50d4-4ee0-975e-164335c96f29 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:45.101099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-04c07e28-50d4-4ee0-975e-164335c96f29 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:45.101099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-04c07e28-50d4-4ee0-975e-164335c96f29 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:45.101099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-04c07e28-50d4-4ee0-975e-164335c96f29 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:45.102091 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-04c07e28-50d4-4ee0-975e-164335c96f29 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:45.102091 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-04c07e28-50d4-4ee0-975e-164335c96f29 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:45.105549 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:45.305838 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-04c07e28-50d4-4ee0-975e-164335c96f29 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:45.314252 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-04c07e28-50d4-4ee0-975e-164335c96f29 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1360 microversion: 2.1 time: 0.229354 Aug 08 16:58:45.314885 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 437/861] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:45 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1360 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:45.341647 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-8861c5ea-7b95-41f3-9e33-19a5fdf92650 req-41b6191c-355d-42a1-a738-7eee6e4e3669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22dcddde-2c2c-4300-83ee-62dab4e9bb2b", "tag": "5534e07d-dc1b-4632-a0a2-2a150667e474"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:45.353675 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-8861c5ea-7b95-41f3-9e33-19a5fdf92650 req-41b6191c-355d-42a1-a738-7eee6e4e3669 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:45.361736 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-8861c5ea-7b95-41f3-9e33-19a5fdf92650 req-41b6191c-355d-42a1-a738-7eee6e4e3669 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:45.361736 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-8861c5ea-7b95-41f3-9e33-19a5fdf92650 req-41b6191c-355d-42a1-a738-7eee6e4e3669 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:45.377532 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-8861c5ea-7b95-41f3-9e33-19a5fdf92650 req-41b6191c-355d-42a1-a738-7eee6e4e3669 service nova] Creating event network-changed:5534e07d-dc1b-4632-a0a2-2a150667e474 for instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b on hv-cinder-85220 Aug 08 16:58:45.385633 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-8861c5ea-7b95-41f3-9e33-19a5fdf92650 req-41b6191c-355d-42a1-a738-7eee6e4e3669 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047416 Aug 08 16:58:45.386692 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 425/862] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:46.338210 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-dcc1d573-a55a-4357-af75-bd92927b7dce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:46.339042 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-dcc1d573-a55a-4357-af75-bd92927b7dce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:46.346353 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dcc1d573-a55a-4357-af75-bd92927b7dce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:46.346885 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dcc1d573-a55a-4357-af75-bd92927b7dce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:46.347358 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dcc1d573-a55a-4357-af75-bd92927b7dce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:46.348133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dcc1d573-a55a-4357-af75-bd92927b7dce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:46.348746 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dcc1d573-a55a-4357-af75-bd92927b7dce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:46.349211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dcc1d573-a55a-4357-af75-bd92927b7dce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:46.527303 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-dcc1d573-a55a-4357-af75-bd92927b7dce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:46.535936 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-dcc1d573-a55a-4357-af75-bd92927b7dce tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1360 microversion: 2.1 time: 0.203215 Aug 08 16:58:46.537101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 438/863] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:46 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1360 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:47.572924 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4c66163e-8513-464a-9b31-519b9ce926b1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:47.573524 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4c66163e-8513-464a-9b31-519b9ce926b1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:47.580216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4c66163e-8513-464a-9b31-519b9ce926b1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:47.580705 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4c66163e-8513-464a-9b31-519b9ce926b1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:47.581144 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4c66163e-8513-464a-9b31-519b9ce926b1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:47.581900 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4c66163e-8513-464a-9b31-519b9ce926b1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:47.582360 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4c66163e-8513-464a-9b31-519b9ce926b1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:47.583029 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4c66163e-8513-464a-9b31-519b9ce926b1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:47.751195 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4c66163e-8513-464a-9b31-519b9ce926b1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:47.760309 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4c66163e-8513-464a-9b31-519b9ce926b1 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1360 microversion: 2.1 time: 0.192469 Aug 08 16:58:47.761113 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 426/864] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:47 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1360 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:48.784535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0e1164f8-b40f-441c-ae1c-a816cead9584 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:48.785140 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0e1164f8-b40f-441c-ae1c-a816cead9584 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:48.792827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0e1164f8-b40f-441c-ae1c-a816cead9584 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:48.793468 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0e1164f8-b40f-441c-ae1c-a816cead9584 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:48.794211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0e1164f8-b40f-441c-ae1c-a816cead9584 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:48.795380 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0e1164f8-b40f-441c-ae1c-a816cead9584 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:48.795895 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0e1164f8-b40f-441c-ae1c-a816cead9584 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:48.796467 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0e1164f8-b40f-441c-ae1c-a816cead9584 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:48.966299 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0e1164f8-b40f-441c-ae1c-a816cead9584 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:48.974647 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0e1164f8-b40f-441c-ae1c-a816cead9584 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1360 microversion: 2.1 time: 0.194377 Aug 08 16:58:48.975840 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 439/865] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:48 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1360 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:49.996691 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f7b75a83-906e-4db9-a68e-0843801f9e2a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:49.997570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f7b75a83-906e-4db9-a68e-0843801f9e2a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:50.004665 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7b75a83-906e-4db9-a68e-0843801f9e2a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:50.005137 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7b75a83-906e-4db9-a68e-0843801f9e2a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:50.005593 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7b75a83-906e-4db9-a68e-0843801f9e2a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:50.006336 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7b75a83-906e-4db9-a68e-0843801f9e2a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:50.006839 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7b75a83-906e-4db9-a68e-0843801f9e2a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:50.007276 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7b75a83-906e-4db9-a68e-0843801f9e2a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:50.155757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:50.182691 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f7b75a83-906e-4db9-a68e-0843801f9e2a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:50.192491 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f7b75a83-906e-4db9-a68e-0843801f9e2a tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1360 microversion: 2.1 time: 0.199931 Aug 08 16:58:50.193528 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 427/866] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:49 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1360 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:51.214380 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b1edc39d-4e3a-44b3-ae58-eebbb52276e0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:51.215137 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b1edc39d-4e3a-44b3-ae58-eebbb52276e0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:51.217573 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=6 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:51.224412 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b1edc39d-4e3a-44b3-ae58-eebbb52276e0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:51.225073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b1edc39d-4e3a-44b3-ae58-eebbb52276e0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:51.225604 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b1edc39d-4e3a-44b3-ae58-eebbb52276e0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:51.232677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b1edc39d-4e3a-44b3-ae58-eebbb52276e0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:51.232677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b1edc39d-4e3a-44b3-ae58-eebbb52276e0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:51.232677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b1edc39d-4e3a-44b3-ae58-eebbb52276e0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:51.389266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b1edc39d-4e3a-44b3-ae58-eebbb52276e0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:51.398420 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b1edc39d-4e3a-44b3-ae58-eebbb52276e0 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1360 microversion: 2.1 time: 0.187901 Aug 08 16:58:51.399068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 440/867] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:51 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1360 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:52.142778 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-01a7084e-7b10-464d-81b4-ea702041247e req-686986c5-b2f6-4331-97c0-205e41eed6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22dcddde-2c2c-4300-83ee-62dab4e9bb2b", "name": "network-vif-plugged", "status": "completed", "tag": "5534e07d-dc1b-4632-a0a2-2a150667e474"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:52.155429 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=6 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:58:52.160443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-01a7084e-7b10-464d-81b4-ea702041247e req-686986c5-b2f6-4331-97c0-205e41eed6d4 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:52.161161 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-01a7084e-7b10-464d-81b4-ea702041247e req-686986c5-b2f6-4331-97c0-205e41eed6d4 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:52.161594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-01a7084e-7b10-464d-81b4-ea702041247e req-686986c5-b2f6-4331-97c0-205e41eed6d4 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:52.174101 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-01a7084e-7b10-464d-81b4-ea702041247e req-686986c5-b2f6-4331-97c0-205e41eed6d4 service nova] Creating event network-vif-plugged:5534e07d-dc1b-4632-a0a2-2a150667e474 for instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b on hv-cinder-85220 Aug 08 16:58:52.180040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-01a7084e-7b10-464d-81b4-ea702041247e req-686986c5-b2f6-4331-97c0-205e41eed6d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044519 Aug 08 16:58:52.180650 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 428/868] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:58:52.421088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-36775ada-d521-4210-bbea-f934e81389d6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:52.421913 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-36775ada-d521-4210-bbea-f934e81389d6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:52.429926 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-36775ada-d521-4210-bbea-f934e81389d6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:52.430427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-36775ada-d521-4210-bbea-f934e81389d6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:52.434272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-36775ada-d521-4210-bbea-f934e81389d6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:52.434272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-36775ada-d521-4210-bbea-f934e81389d6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:52.434272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-36775ada-d521-4210-bbea-f934e81389d6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:52.434272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-36775ada-d521-4210-bbea-f934e81389d6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:52.605118 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-36775ada-d521-4210-bbea-f934e81389d6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:52.613248 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-36775ada-d521-4210-bbea-f934e81389d6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1360 microversion: 2.1 time: 0.196202 Aug 08 16:58:52.614551 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 441/869] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:52 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1360 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:58:53.636315 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6f7f563b-2981-496b-b647-f0eec606da41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:53.637058 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6f7f563b-2981-496b-b647-f0eec606da41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:53.644719 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6f7f563b-2981-496b-b647-f0eec606da41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:53.645682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6f7f563b-2981-496b-b647-f0eec606da41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:53.646259 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6f7f563b-2981-496b-b647-f0eec606da41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:53.647105 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6f7f563b-2981-496b-b647-f0eec606da41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:53.647618 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6f7f563b-2981-496b-b647-f0eec606da41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:53.648090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6f7f563b-2981-496b-b647-f0eec606da41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:53.816500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-6f7f563b-2981-496b-b647-f0eec606da41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:53.825831 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-6f7f563b-2981-496b-b647-f0eec606da41 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1360 microversion: 2.1 time: 0.193743 Aug 08 16:58:53.826471 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 429/870] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:53 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1360 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:54.849797 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-85d0faa6-bb5e-4ea8-851a-5e4df7b7f2f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:54.850527 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-85d0faa6-bb5e-4ea8-851a-5e4df7b7f2f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:54.857350 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-85d0faa6-bb5e-4ea8-851a-5e4df7b7f2f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:54.857840 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-85d0faa6-bb5e-4ea8-851a-5e4df7b7f2f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:54.858304 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-85d0faa6-bb5e-4ea8-851a-5e4df7b7f2f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:54.859064 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-85d0faa6-bb5e-4ea8-851a-5e4df7b7f2f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:54.859516 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-85d0faa6-bb5e-4ea8-851a-5e4df7b7f2f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:54.859971 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-85d0faa6-bb5e-4ea8-851a-5e4df7b7f2f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:55.028533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-85d0faa6-bb5e-4ea8-851a-5e4df7b7f2f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:55.043792 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-85d0faa6-bb5e-4ea8-851a-5e4df7b7f2f4 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1546 microversion: 2.1 time: 0.197669 Aug 08 16:58:55.044832 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 442/871] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:54 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:55.067770 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8e71a4be-cd81-4ac1-aa0b-46055f724b49 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:55.068716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8e71a4be-cd81-4ac1-aa0b-46055f724b49 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:55.075921 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e71a4be-cd81-4ac1-aa0b-46055f724b49 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:55.076489 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e71a4be-cd81-4ac1-aa0b-46055f724b49 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:55.076918 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e71a4be-cd81-4ac1-aa0b-46055f724b49 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:55.077636 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e71a4be-cd81-4ac1-aa0b-46055f724b49 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:55.078090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e71a4be-cd81-4ac1-aa0b-46055f724b49 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:55.078516 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e71a4be-cd81-4ac1-aa0b-46055f724b49 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:55.175491 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8e71a4be-cd81-4ac1-aa0b-46055f724b49 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112595 Aug 08 16:58:55.176586 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 430/872] 10.222.0.13 () {58 vars in 1275 bytes} [Mon Aug 8 16:58:55 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:55.907839 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2075178266", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1165660734", "security_groups": [{"name": "tempest-secgroup-smoke-964215773"}], "networks": [{"uuid": "3a046035-a56c-413a-96b9-8ca48c59df48"}], "block_device_mapping_v2": [{"uuid": "40ccb949-8ffd-4707-b35c-75becb8449fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:56.071114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.network.neutron [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] validate_networks() for [('3a046035-a56c-413a-96b9-8ca48c59df48', None, None, None, None, None)] {{(pid=130236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:58:56.517509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-f83898c8-06da-4a77-8717-69a4d261eb74 req-ae599cd3-ffba-4b1e-b53b-83979de60775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22dcddde-2c2c-4300-83ee-62dab4e9bb2b", "tag": "5534e07d-dc1b-4632-a0a2-2a150667e474"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:58:56.536773 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-f83898c8-06da-4a77-8717-69a4d261eb74 req-ae599cd3-ffba-4b1e-b53b-83979de60775 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:56.537815 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-f83898c8-06da-4a77-8717-69a4d261eb74 req-ae599cd3-ffba-4b1e-b53b-83979de60775 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:56.538652 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-f83898c8-06da-4a77-8717-69a4d261eb74 req-ae599cd3-ffba-4b1e-b53b-83979de60775 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:56.552127 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-f83898c8-06da-4a77-8717-69a4d261eb74 req-ae599cd3-ffba-4b1e-b53b-83979de60775 service nova] Creating event network-changed:5534e07d-dc1b-4632-a0a2-2a150667e474 for instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b on hv-cinder-85220 Aug 08 16:58:56.562670 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-f83898c8-06da-4a77-8717-69a4d261eb74 req-ae599cd3-ffba-4b1e-b53b-83979de60775 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047541 Aug 08 16:58:56.562670 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 431/873] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:58:56.595289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Flavor limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:58:56.596202 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Image limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:58:56.597301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Flavor pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:58:56.598472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Image pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:58:56.603050 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:58:56.618063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:56.619151 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:56.619773 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:56.620718 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:56.622258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:56.623377 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:56.651404 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Getting quotas for project 73ca0765d1fb44cda1c4c2562a695ac6. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:58:56.657512 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Getting quotas for user 803b15aebfb044c3893831f84f1aa1d7 and project 73ca0765d1fb44cda1c4c2562a695ac6. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:58:56.758121 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Going to run 1 instances... {{(pid=130236) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:58:56.758121 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40ccb949-8ffd-4707-b35c-75becb8449fe',volume_size=None,volume_type=None)] {{(pid=130236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:58:57.293938 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-70c312df-b259-48d7-b0b4-b58795ec35b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.389235 Aug 08 16:58:57.295625 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 443/874] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:58:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 16:58:57.317830 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-56babb33-d4f1-4f9a-9e1d-29354e4cb9ec tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:57.319950 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-56babb33-d4f1-4f9a-9e1d-29354e4cb9ec tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:57.458694 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-56babb33-d4f1-4f9a-9e1d-29354e4cb9ec tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:57.467802 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-56babb33-d4f1-4f9a-9e1d-29354e4cb9ec tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1089 microversion: 2.1 time: 0.158395 Aug 08 16:58:57.470131 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 432/875] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:57 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1089 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:58.504185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d42a846b-a7ec-420a-a34c-3827e617f9d5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:58.505244 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d42a846b-a7ec-420a-a34c-3827e617f9d5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:58.585851 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d42a846b-a7ec-420a-a34c-3827e617f9d5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:58.598519 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d42a846b-a7ec-420a-a34c-3827e617f9d5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1089 microversion: 2.1 time: 0.100077 Aug 08 16:58:58.599534 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 444/876] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:58 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1089 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:58:59.621203 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-bb2bbe17-4851-4582-bc0a-c27e989a88cd tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:58:59.622137 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-bb2bbe17-4851-4582-bc0a-c27e989a88cd tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:58:59.630803 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bb2bbe17-4851-4582-bc0a-c27e989a88cd tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:59.631368 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bb2bbe17-4851-4582-bc0a-c27e989a88cd tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:59.632102 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bb2bbe17-4851-4582-bc0a-c27e989a88cd tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:59.632891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bb2bbe17-4851-4582-bc0a-c27e989a88cd tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:58:59.633416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bb2bbe17-4851-4582-bc0a-c27e989a88cd tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:58:59.633892 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bb2bbe17-4851-4582-bc0a-c27e989a88cd tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:58:59.711148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-bb2bbe17-4851-4582-bc0a-c27e989a88cd tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:58:59.715332 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-bb2bbe17-4851-4582-bc0a-c27e989a88cd tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1187 microversion: 2.1 time: 0.098303 Aug 08 16:58:59.715962 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 433/877] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:58:59 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:00.738610 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-59bc419d-ead6-467c-a94c-80f0643b18de tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:00.744327 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-59bc419d-ead6-467c-a94c-80f0643b18de tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:00.744327 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:00.748773 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-59bc419d-ead6-467c-a94c-80f0643b18de tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:00.749257 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-59bc419d-ead6-467c-a94c-80f0643b18de tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:00.749691 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-59bc419d-ead6-467c-a94c-80f0643b18de tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:00.750399 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-59bc419d-ead6-467c-a94c-80f0643b18de tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:00.750881 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-59bc419d-ead6-467c-a94c-80f0643b18de tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:00.751304 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-59bc419d-ead6-467c-a94c-80f0643b18de tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:00.829674 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-59bc419d-ead6-467c-a94c-80f0643b18de tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:00.839393 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-59bc419d-ead6-467c-a94c-80f0643b18de tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1205 microversion: 2.1 time: 0.106026 Aug 08 16:59:00.840128 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 445/878] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:00 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1205 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:01.867377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1025db25-e7a3-4404-87ee-a34e7da3f607 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:01.868473 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1025db25-e7a3-4404-87ee-a34e7da3f607 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:01.897231 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1025db25-e7a3-4404-87ee-a34e7da3f607 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:01.898064 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1025db25-e7a3-4404-87ee-a34e7da3f607 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:01.898954 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1025db25-e7a3-4404-87ee-a34e7da3f607 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:01.900150 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1025db25-e7a3-4404-87ee-a34e7da3f607 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:01.901063 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1025db25-e7a3-4404-87ee-a34e7da3f607 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:01.901895 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1025db25-e7a3-4404-87ee-a34e7da3f607 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:01.947309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5ca29c90-939a-4396-ba9f-feeac0905989 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:01.948681 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5ca29c90-939a-4396-ba9f-feeac0905989 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:01.959928 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5ca29c90-939a-4396-ba9f-feeac0905989 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:01.960802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5ca29c90-939a-4396-ba9f-feeac0905989 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:01.961258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5ca29c90-939a-4396-ba9f-feeac0905989 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:01.961989 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5ca29c90-939a-4396-ba9f-feeac0905989 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:01.962641 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5ca29c90-939a-4396-ba9f-feeac0905989 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:01.963079 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5ca29c90-939a-4396-ba9f-feeac0905989 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:02.105645 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-5ca29c90-939a-4396-ba9f-feeac0905989 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lazy-loading 'services' on Instance uuid af731dd6-88e0-49bd-b38b-3b629bf771bb {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:59:02.176716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1025db25-e7a3-4404-87ee-a34e7da3f607 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:02.188547 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1025db25-e7a3-4404-87ee-a34e7da3f607 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1272 microversion: 2.1 time: 0.330092 Aug 08 16:59:02.189463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 434/879] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:01 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1272 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:02.375208 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5ca29c90-939a-4396-ba9f-feeac0905989 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "DELETE /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-volume_attachments/fad196b8-b7c0-4baf-a7cb-e60187f87ce5" status: 202 len: 0 microversion: 2.1 time: 0.436714 Aug 08 16:59:02.376050 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 446/880] 10.222.0.13 () {58 vars in 1416 bytes} [Mon Aug 8 16:59:01 2022] DELETE /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-volume_attachments/fad196b8-b7c0-4baf-a7cb-e60187f87ce5 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 16:59:02.385800 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9be0dc39-ea73-467e-ad9d-cb217893d86e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:02.390230 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9be0dc39-ea73-467e-ad9d-cb217893d86e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:02.414073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9be0dc39-ea73-467e-ad9d-cb217893d86e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:02.414596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9be0dc39-ea73-467e-ad9d-cb217893d86e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:02.415169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9be0dc39-ea73-467e-ad9d-cb217893d86e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:02.416230 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9be0dc39-ea73-467e-ad9d-cb217893d86e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:02.416683 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9be0dc39-ea73-467e-ad9d-cb217893d86e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:02.417294 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9be0dc39-ea73-467e-ad9d-cb217893d86e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:02.452061 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9be0dc39-ea73-467e-ad9d-cb217893d86e tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070292 Aug 08 16:59:02.452872 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 435/881] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:59:02 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:02.968002 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-c6888dc4-61f5-4cca-a109-eff0d42249f8 req-04ca80f9-0a7f-447e-96f6-3407ad1316b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff2191f-71f9-44b6-ae73-7e7385c80748", "tag": "c2eba598-5d72-4cf8-b348-8af93d348bb8"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:02.984169 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-c6888dc4-61f5-4cca-a109-eff0d42249f8 req-04ca80f9-0a7f-447e-96f6-3407ad1316b4 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:02.985009 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-c6888dc4-61f5-4cca-a109-eff0d42249f8 req-04ca80f9-0a7f-447e-96f6-3407ad1316b4 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:02.985781 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-c6888dc4-61f5-4cca-a109-eff0d42249f8 req-04ca80f9-0a7f-447e-96f6-3407ad1316b4 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:03.009267 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-c6888dc4-61f5-4cca-a109-eff0d42249f8 req-04ca80f9-0a7f-447e-96f6-3407ad1316b4 service nova] Creating event network-changed:c2eba598-5d72-4cf8-b348-8af93d348bb8 for instance eff2191f-71f9-44b6-ae73-7e7385c80748 on hv-cinder-85220 Aug 08 16:59:03.017809 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-c6888dc4-61f5-4cca-a109-eff0d42249f8 req-04ca80f9-0a7f-447e-96f6-3407ad1316b4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056737 Aug 08 16:59:03.018983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 447/882] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:03.224511 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c8e27708-b03d-46c4-b179-a1f091538d30 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:03.225355 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c8e27708-b03d-46c4-b179-a1f091538d30 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:03.232137 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c8e27708-b03d-46c4-b179-a1f091538d30 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:03.232680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c8e27708-b03d-46c4-b179-a1f091538d30 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:03.233105 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c8e27708-b03d-46c4-b179-a1f091538d30 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:03.233876 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c8e27708-b03d-46c4-b179-a1f091538d30 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:03.234307 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c8e27708-b03d-46c4-b179-a1f091538d30 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:03.234771 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c8e27708-b03d-46c4-b179-a1f091538d30 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:03.470038 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7074f2ee-c2b9-4d25-8dd3-685aa1827626 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:03.472688 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7074f2ee-c2b9-4d25-8dd3-685aa1827626 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:03.479764 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7074f2ee-c2b9-4d25-8dd3-685aa1827626 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:03.480264 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7074f2ee-c2b9-4d25-8dd3-685aa1827626 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:03.480711 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7074f2ee-c2b9-4d25-8dd3-685aa1827626 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:03.481434 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7074f2ee-c2b9-4d25-8dd3-685aa1827626 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:03.482056 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7074f2ee-c2b9-4d25-8dd3-685aa1827626 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:03.482497 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7074f2ee-c2b9-4d25-8dd3-685aa1827626 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:03.492973 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c8e27708-b03d-46c4-b179-a1f091538d30 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:03.505020 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c8e27708-b03d-46c4-b179-a1f091538d30 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1260 microversion: 2.1 time: 0.285175 Aug 08 16:59:03.505944 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 436/883] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:03 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1260 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:03.537238 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7074f2ee-c2b9-4d25-8dd3-685aa1827626 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071900 Aug 08 16:59:03.538310 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 448/884] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:59:03 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:04.546561 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e149b143-7530-4593-b0b3-016f1186611b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:04.547635 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e149b143-7530-4593-b0b3-016f1186611b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:04.561194 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e149b143-7530-4593-b0b3-016f1186611b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:04.562439 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e149b143-7530-4593-b0b3-016f1186611b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:04.563220 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e149b143-7530-4593-b0b3-016f1186611b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:04.564957 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e149b143-7530-4593-b0b3-016f1186611b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:04.565728 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e149b143-7530-4593-b0b3-016f1186611b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:04.567092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e149b143-7530-4593-b0b3-016f1186611b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:04.567997 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b8a26644-3312-4f2e-b251-e37b3fcdee79 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:04.571569 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b8a26644-3312-4f2e-b251-e37b3fcdee79 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:04.593456 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8a26644-3312-4f2e-b251-e37b3fcdee79 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:04.593954 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8a26644-3312-4f2e-b251-e37b3fcdee79 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:04.595610 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8a26644-3312-4f2e-b251-e37b3fcdee79 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:04.596884 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8a26644-3312-4f2e-b251-e37b3fcdee79 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:04.598150 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8a26644-3312-4f2e-b251-e37b3fcdee79 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:04.598956 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b8a26644-3312-4f2e-b251-e37b3fcdee79 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:04.637523 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b8a26644-3312-4f2e-b251-e37b3fcdee79 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091128 Aug 08 16:59:04.638118 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 449/885] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:59:04 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 16:59:04.733625 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-dddf63fd-4035-44cf-b702-3b1893f30f42 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:04.736244 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-dddf63fd-4035-44cf-b702-3b1893f30f42 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:04.741718 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dddf63fd-4035-44cf-b702-3b1893f30f42 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:04.742208 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dddf63fd-4035-44cf-b702-3b1893f30f42 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:04.742695 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dddf63fd-4035-44cf-b702-3b1893f30f42 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:04.743405 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dddf63fd-4035-44cf-b702-3b1893f30f42 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:04.743871 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dddf63fd-4035-44cf-b702-3b1893f30f42 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:04.744296 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dddf63fd-4035-44cf-b702-3b1893f30f42 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:04.774515 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-dddf63fd-4035-44cf-b702-3b1893f30f42 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:59:04.779473 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e149b143-7530-4593-b0b3-016f1186611b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:04.787527 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e149b143-7530-4593-b0b3-016f1186611b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1260 microversion: 2.1 time: 0.248934 Aug 08 16:59:04.788155 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 437/886] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:04 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:05.081772 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-dddf63fd-4035-44cf-b702-3b1893f30f42 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "DELETE /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 204 len: 0 microversion: 2.1 time: 0.351673 Aug 08 16:59:05.082700 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 450/887] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:59:04 2022] DELETE /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 16:59:05.092002 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-603459fb-4391-493d-b402-32ea71674774 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:05.092698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-603459fb-4391-493d-b402-32ea71674774 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:05.099871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-603459fb-4391-493d-b402-32ea71674774 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:05.100368 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-603459fb-4391-493d-b402-32ea71674774 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:05.100816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-603459fb-4391-493d-b402-32ea71674774 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:05.101677 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-603459fb-4391-493d-b402-32ea71674774 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:05.102132 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-603459fb-4391-493d-b402-32ea71674774 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:05.102604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-603459fb-4391-493d-b402-32ea71674774 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:05.251812 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-603459fb-4391-493d-b402-32ea71674774 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:05.261058 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-603459fb-4391-493d-b402-32ea71674774 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1690 microversion: 2.1 time: 0.173063 Aug 08 16:59:05.261744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 438/888] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:05 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:05.809451 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ae730f65-084c-49e8-991c-2b5c9de681fc tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:05.810212 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ae730f65-084c-49e8-991c-2b5c9de681fc tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:05.817650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae730f65-084c-49e8-991c-2b5c9de681fc tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:05.818138 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae730f65-084c-49e8-991c-2b5c9de681fc tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:05.818596 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae730f65-084c-49e8-991c-2b5c9de681fc tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:05.819315 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae730f65-084c-49e8-991c-2b5c9de681fc tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:05.819773 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae730f65-084c-49e8-991c-2b5c9de681fc tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:05.820195 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae730f65-084c-49e8-991c-2b5c9de681fc tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:05.970470 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ae730f65-084c-49e8-991c-2b5c9de681fc tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:05.979087 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ae730f65-084c-49e8-991c-2b5c9de681fc tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1260 microversion: 2.1 time: 0.174116 Aug 08 16:59:05.979677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 451/889] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:05 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:06.284052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ff6d94f3-23aa-4213-81c3-81ceba3fda59 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:06.284683 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ff6d94f3-23aa-4213-81c3-81ceba3fda59 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:06.291774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff6d94f3-23aa-4213-81c3-81ceba3fda59 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:06.292272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff6d94f3-23aa-4213-81c3-81ceba3fda59 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:06.292714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff6d94f3-23aa-4213-81c3-81ceba3fda59 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:06.293439 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff6d94f3-23aa-4213-81c3-81ceba3fda59 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:06.293899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff6d94f3-23aa-4213-81c3-81ceba3fda59 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:06.294336 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff6d94f3-23aa-4213-81c3-81ceba3fda59 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:06.450396 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ff6d94f3-23aa-4213-81c3-81ceba3fda59 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:06.460381 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ff6d94f3-23aa-4213-81c3-81ceba3fda59 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1690 microversion: 2.1 time: 0.180088 Aug 08 16:59:06.461150 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 439/890] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:06 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:59:06.999624 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8e7fe35b-f0e6-4c98-85f7-304e4540b6a0 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:07.000275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8e7fe35b-f0e6-4c98-85f7-304e4540b6a0 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:07.002378 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:07.010058 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8e7fe35b-f0e6-4c98-85f7-304e4540b6a0 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:07.012588 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8e7fe35b-f0e6-4c98-85f7-304e4540b6a0 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:07.012588 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8e7fe35b-f0e6-4c98-85f7-304e4540b6a0 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:07.012588 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8e7fe35b-f0e6-4c98-85f7-304e4540b6a0 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:07.012588 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8e7fe35b-f0e6-4c98-85f7-304e4540b6a0 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:07.013193 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8e7fe35b-f0e6-4c98-85f7-304e4540b6a0 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:07.201279 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8e7fe35b-f0e6-4c98-85f7-304e4540b6a0 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:07.205025 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-8e7fe35b-f0e6-4c98-85f7-304e4540b6a0 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1260 microversion: 2.1 time: 0.209444 Aug 08 16:59:07.205747 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 452/891] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:06 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:07.328093 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3a84b87a-e01d-4cf4-886e-5110728bcc83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:07.328985 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-3a84b87a-e01d-4cf4-886e-5110728bcc83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:07.339857 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3a84b87a-e01d-4cf4-886e-5110728bcc83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:07.347833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3a84b87a-e01d-4cf4-886e-5110728bcc83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:07.347833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3a84b87a-e01d-4cf4-886e-5110728bcc83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:07.347833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3a84b87a-e01d-4cf4-886e-5110728bcc83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:07.347833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3a84b87a-e01d-4cf4-886e-5110728bcc83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:07.348240 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3a84b87a-e01d-4cf4-886e-5110728bcc83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:07.404525 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-3a84b87a-e01d-4cf4-886e-5110728bcc83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments/b83a465a-0871-4926-84ec-b8357500084b" status: 200 len: 194 microversion: 2.20 time: 0.226681 Aug 08 16:59:07.406037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 440/892] 10.222.0.13 () {60 vars in 1454 bytes} [Mon Aug 8 16:59:07 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments/b83a465a-0871-4926-84ec-b8357500084b => generated 194 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 16:59:07.488266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9301c480-46fc-4094-a150-fbc70acb1298 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:07.488266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9301c480-46fc-4094-a150-fbc70acb1298 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:07.495102 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9301c480-46fc-4094-a150-fbc70acb1298 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:07.496150 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9301c480-46fc-4094-a150-fbc70acb1298 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:07.496645 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9301c480-46fc-4094-a150-fbc70acb1298 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:07.497545 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9301c480-46fc-4094-a150-fbc70acb1298 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:07.498201 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9301c480-46fc-4094-a150-fbc70acb1298 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:07.498840 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9301c480-46fc-4094-a150-fbc70acb1298 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:07.517108 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0782acb2-fb6c-49f5-9e8e-faeced12b4b8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:07.518013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0782acb2-fb6c-49f5-9e8e-faeced12b4b8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:07.522289 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:07.531596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0782acb2-fb6c-49f5-9e8e-faeced12b4b8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:07.533640 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0782acb2-fb6c-49f5-9e8e-faeced12b4b8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:07.533640 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0782acb2-fb6c-49f5-9e8e-faeced12b4b8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:07.534512 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0782acb2-fb6c-49f5-9e8e-faeced12b4b8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:07.535524 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0782acb2-fb6c-49f5-9e8e-faeced12b4b8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:07.536300 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0782acb2-fb6c-49f5-9e8e-faeced12b4b8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:07.666640 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9301c480-46fc-4094-a150-fbc70acb1298 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:07.670345 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:07.677104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-0782acb2-fb6c-49f5-9e8e-faeced12b4b8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lazy-loading 'services' on Instance uuid f70c7402-29f3-48b0-b5fc-dd586f6e4266 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:59:07.685218 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9301c480-46fc-4094-a150-fbc70acb1298 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1690 microversion: 2.1 time: 0.200924 Aug 08 16:59:07.685218 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 453/893] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:07 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:07.944550 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0782acb2-fb6c-49f5-9e8e-faeced12b4b8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments/b83a465a-0871-4926-84ec-b8357500084b" status: 202 len: 0 microversion: 2.20 time: 0.433544 Aug 08 16:59:07.945155 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 441/894] 10.222.0.13 () {60 vars in 1457 bytes} [Mon Aug 8 16:59:07 2022] DELETE /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments/b83a465a-0871-4926-84ec-b8357500084b => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 08 16:59:07.958343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-da860e87-c9c5-4597-bee3-af066588350a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:07.960722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-da860e87-c9c5-4597-bee3-af066588350a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:07.967698 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-da860e87-c9c5-4597-bee3-af066588350a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:07.968183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-da860e87-c9c5-4597-bee3-af066588350a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:07.968618 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-da860e87-c9c5-4597-bee3-af066588350a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:07.969339 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-da860e87-c9c5-4597-bee3-af066588350a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:07.969791 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-da860e87-c9c5-4597-bee3-af066588350a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:07.970216 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-da860e87-c9c5-4597-bee3-af066588350a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:08.008387 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-da860e87-c9c5-4597-bee3-af066588350a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055926 Aug 08 16:59:08.009247 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 454/895] 10.222.0.13 () {60 vars in 1343 bytes} [Mon Aug 8 16:59:07 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:59:08.231133 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2a71cc73-acc9-4d05-8c38-a6d3dc4af4b7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:08.231927 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2a71cc73-acc9-4d05-8c38-a6d3dc4af4b7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:08.240457 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a71cc73-acc9-4d05-8c38-a6d3dc4af4b7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:08.241008 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a71cc73-acc9-4d05-8c38-a6d3dc4af4b7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:08.241463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a71cc73-acc9-4d05-8c38-a6d3dc4af4b7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:08.242178 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a71cc73-acc9-4d05-8c38-a6d3dc4af4b7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:08.242671 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a71cc73-acc9-4d05-8c38-a6d3dc4af4b7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:08.250653 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2a71cc73-acc9-4d05-8c38-a6d3dc4af4b7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:08.261516 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:08.403978 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2a71cc73-acc9-4d05-8c38-a6d3dc4af4b7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:08.412784 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2a71cc73-acc9-4d05-8c38-a6d3dc4af4b7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1260 microversion: 2.1 time: 0.186918 Aug 08 16:59:08.413373 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 442/896] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:08 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:59:08.704906 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-01e7e217-7b6f-4495-be70-d6cd3dc6c4de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:08.705532 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-01e7e217-7b6f-4495-be70-d6cd3dc6c4de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:08.708736 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=8 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:08.714363 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01e7e217-7b6f-4495-be70-d6cd3dc6c4de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:08.719830 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01e7e217-7b6f-4495-be70-d6cd3dc6c4de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:08.719830 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01e7e217-7b6f-4495-be70-d6cd3dc6c4de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:08.719830 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01e7e217-7b6f-4495-be70-d6cd3dc6c4de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:08.719830 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01e7e217-7b6f-4495-be70-d6cd3dc6c4de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:08.720390 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01e7e217-7b6f-4495-be70-d6cd3dc6c4de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:08.869792 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-01e7e217-7b6f-4495-be70-d6cd3dc6c4de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:08.877926 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-01e7e217-7b6f-4495-be70-d6cd3dc6c4de tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1690 microversion: 2.1 time: 0.177096 Aug 08 16:59:08.880279 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 455/897] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:08 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:09.022009 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f5bb6269-4f3d-484c-bbc1-7a0a5bf3240b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:09.024386 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f5bb6269-4f3d-484c-bbc1-7a0a5bf3240b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:09.031117 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f5bb6269-4f3d-484c-bbc1-7a0a5bf3240b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:09.033444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f5bb6269-4f3d-484c-bbc1-7a0a5bf3240b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:09.033444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f5bb6269-4f3d-484c-bbc1-7a0a5bf3240b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:09.033444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f5bb6269-4f3d-484c-bbc1-7a0a5bf3240b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:09.033444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f5bb6269-4f3d-484c-bbc1-7a0a5bf3240b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:09.034055 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f5bb6269-4f3d-484c-bbc1-7a0a5bf3240b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:09.072611 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f5bb6269-4f3d-484c-bbc1-7a0a5bf3240b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054719 Aug 08 16:59:09.073221 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 443/898] 10.222.0.13 () {60 vars in 1343 bytes} [Mon Aug 8 16:59:09 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:59:09.434492 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4fd68cd0-2426-4bdf-877d-1afc602987b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:09.435159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4fd68cd0-2426-4bdf-877d-1afc602987b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:09.442334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4fd68cd0-2426-4bdf-877d-1afc602987b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:09.442848 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4fd68cd0-2426-4bdf-877d-1afc602987b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:09.443290 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4fd68cd0-2426-4bdf-877d-1afc602987b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:09.444013 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4fd68cd0-2426-4bdf-877d-1afc602987b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:09.444474 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4fd68cd0-2426-4bdf-877d-1afc602987b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:09.444897 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4fd68cd0-2426-4bdf-877d-1afc602987b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:09.596586 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4fd68cd0-2426-4bdf-877d-1afc602987b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:09.605170 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4fd68cd0-2426-4bdf-877d-1afc602987b9 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1260 microversion: 2.1 time: 0.174843 Aug 08 16:59:09.605767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 456/899] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:09 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:09.902063 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d52b63bf-0cb1-42db-b404-34d54141f3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:09.902751 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d52b63bf-0cb1-42db-b404-34d54141f3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:09.905228 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:09.911507 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d52b63bf-0cb1-42db-b404-34d54141f3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:09.912003 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d52b63bf-0cb1-42db-b404-34d54141f3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:09.912613 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d52b63bf-0cb1-42db-b404-34d54141f3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:09.913357 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d52b63bf-0cb1-42db-b404-34d54141f3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:09.913823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d52b63bf-0cb1-42db-b404-34d54141f3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:09.914258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d52b63bf-0cb1-42db-b404-34d54141f3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:10.090480 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-20bc7310-8bb6-4080-89e5-6ca3f9d575e3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:10.094120 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-20bc7310-8bb6-4080-89e5-6ca3f9d575e3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:10.105304 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20bc7310-8bb6-4080-89e5-6ca3f9d575e3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:10.106188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20bc7310-8bb6-4080-89e5-6ca3f9d575e3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:10.106363 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d52b63bf-0cb1-42db-b404-34d54141f3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:10.107163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20bc7310-8bb6-4080-89e5-6ca3f9d575e3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:10.108486 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20bc7310-8bb6-4080-89e5-6ca3f9d575e3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:10.109282 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20bc7310-8bb6-4080-89e5-6ca3f9d575e3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:10.109941 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20bc7310-8bb6-4080-89e5-6ca3f9d575e3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:10.115708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d52b63bf-0cb1-42db-b404-34d54141f3d8 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1690 microversion: 2.1 time: 0.217801 Aug 08 16:59:10.121820 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 444/900] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:09 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1690 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:10.165476 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-20bc7310-8bb6-4080-89e5-6ca3f9d575e3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082873 Aug 08 16:59:10.165981 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 457/901] 10.222.0.13 () {60 vars in 1343 bytes} [Mon Aug 8 16:59:10 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:59:10.629522 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0b31a60d-af0d-4b91-a4d2-e00f7f83fa09 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:10.630155 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0b31a60d-af0d-4b91-a4d2-e00f7f83fa09 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:10.636993 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0b31a60d-af0d-4b91-a4d2-e00f7f83fa09 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:10.638807 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0b31a60d-af0d-4b91-a4d2-e00f7f83fa09 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:10.638807 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0b31a60d-af0d-4b91-a4d2-e00f7f83fa09 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:10.638807 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0b31a60d-af0d-4b91-a4d2-e00f7f83fa09 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:10.639358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0b31a60d-af0d-4b91-a4d2-e00f7f83fa09 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:10.639631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0b31a60d-af0d-4b91-a4d2-e00f7f83fa09 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:10.814536 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0b31a60d-af0d-4b91-a4d2-e00f7f83fa09 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:10.825040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0b31a60d-af0d-4b91-a4d2-e00f7f83fa09 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1260 microversion: 2.1 time: 0.200988 Aug 08 16:59:10.826278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 445/902] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:10 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:11.138097 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-56f6ad29-a06c-46f4-99e9-2e04a3068c2d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:11.138752 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-56f6ad29-a06c-46f4-99e9-2e04a3068c2d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:11.147176 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f6ad29-a06c-46f4-99e9-2e04a3068c2d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:11.147896 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f6ad29-a06c-46f4-99e9-2e04a3068c2d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:11.148631 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f6ad29-a06c-46f4-99e9-2e04a3068c2d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:11.149810 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f6ad29-a06c-46f4-99e9-2e04a3068c2d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:11.150277 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f6ad29-a06c-46f4-99e9-2e04a3068c2d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:11.150752 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-56f6ad29-a06c-46f4-99e9-2e04a3068c2d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:11.179905 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c9ffc8b3-927a-4a5a-ac42-d91409945dbe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:11.183106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c9ffc8b3-927a-4a5a-ac42-d91409945dbe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:11.192110 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c9ffc8b3-927a-4a5a-ac42-d91409945dbe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:11.192628 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c9ffc8b3-927a-4a5a-ac42-d91409945dbe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:11.193076 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c9ffc8b3-927a-4a5a-ac42-d91409945dbe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:11.193826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c9ffc8b3-927a-4a5a-ac42-d91409945dbe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:11.194294 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c9ffc8b3-927a-4a5a-ac42-d91409945dbe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:11.194771 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c9ffc8b3-927a-4a5a-ac42-d91409945dbe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:11.244558 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c9ffc8b3-927a-4a5a-ac42-d91409945dbe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069539 Aug 08 16:59:11.245668 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 446/903] 10.222.0.13 () {60 vars in 1343 bytes} [Mon Aug 8 16:59:11 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 16:59:11.343595 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-56f6ad29-a06c-46f4-99e9-2e04a3068c2d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:11.356928 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-56f6ad29-a06c-46f4-99e9-2e04a3068c2d tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1690 microversion: 2.1 time: 0.222534 Aug 08 16:59:11.357569 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 458/904] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:11 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1690 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:59:11.865132 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4509debe-9b98-458b-9e7f-188214fc8d0f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:11.866208 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4509debe-9b98-458b-9e7f-188214fc8d0f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:11.882133 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4509debe-9b98-458b-9e7f-188214fc8d0f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:11.882954 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4509debe-9b98-458b-9e7f-188214fc8d0f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:11.883745 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4509debe-9b98-458b-9e7f-188214fc8d0f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:11.885008 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4509debe-9b98-458b-9e7f-188214fc8d0f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:11.885799 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4509debe-9b98-458b-9e7f-188214fc8d0f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:11.886689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4509debe-9b98-458b-9e7f-188214fc8d0f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:12.260721 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ac00c35b-7318-470d-b81e-4f5a6d9a3069 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:12.263496 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ac00c35b-7318-470d-b81e-4f5a6d9a3069 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:12.270297 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac00c35b-7318-470d-b81e-4f5a6d9a3069 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:12.270824 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac00c35b-7318-470d-b81e-4f5a6d9a3069 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:12.271268 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac00c35b-7318-470d-b81e-4f5a6d9a3069 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:12.272017 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac00c35b-7318-470d-b81e-4f5a6d9a3069 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:12.272480 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac00c35b-7318-470d-b81e-4f5a6d9a3069 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:12.272979 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac00c35b-7318-470d-b81e-4f5a6d9a3069 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:12.311501 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ac00c35b-7318-470d-b81e-4f5a6d9a3069 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055900 Aug 08 16:59:12.312249 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 459/905] 10.222.0.13 () {60 vars in 1343 bytes} [Mon Aug 8 16:59:12 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 16:59:12.329470 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4509debe-9b98-458b-9e7f-188214fc8d0f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:12.345438 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4509debe-9b98-458b-9e7f-188214fc8d0f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1260 microversion: 2.1 time: 0.489109 Aug 08 16:59:12.347558 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 447/906] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:11 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1260 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:12.387659 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e938f47a-d41f-4aa6-b723-16ed92af0071 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:12.388899 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e938f47a-d41f-4aa6-b723-16ed92af0071 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:12.401314 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e938f47a-d41f-4aa6-b723-16ed92af0071 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:12.402199 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e938f47a-d41f-4aa6-b723-16ed92af0071 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:12.403131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e938f47a-d41f-4aa6-b723-16ed92af0071 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:12.404183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e938f47a-d41f-4aa6-b723-16ed92af0071 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:12.405469 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e938f47a-d41f-4aa6-b723-16ed92af0071 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:12.410418 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e938f47a-d41f-4aa6-b723-16ed92af0071 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:12.644432 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e938f47a-d41f-4aa6-b723-16ed92af0071 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:12.657923 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e938f47a-d41f-4aa6-b723-16ed92af0071 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1690 microversion: 2.1 time: 0.274566 Aug 08 16:59:12.657923 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 460/907] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:12 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1690 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:59:13.328254 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-934eef9b-8cc0-4e21-a783-e9eae77744ef tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:13.332748 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-934eef9b-8cc0-4e21-a783-e9eae77744ef tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:13.344491 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-934eef9b-8cc0-4e21-a783-e9eae77744ef tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:13.345364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-934eef9b-8cc0-4e21-a783-e9eae77744ef tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:13.346161 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-934eef9b-8cc0-4e21-a783-e9eae77744ef tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:13.349099 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-934eef9b-8cc0-4e21-a783-e9eae77744ef tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:13.350018 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-934eef9b-8cc0-4e21-a783-e9eae77744ef tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:13.350852 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-934eef9b-8cc0-4e21-a783-e9eae77744ef tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:13.382362 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fe6d7e05-2b61-4793-8dfc-67197810e30f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:13.383632 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fe6d7e05-2b61-4793-8dfc-67197810e30f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:13.391130 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fe6d7e05-2b61-4793-8dfc-67197810e30f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:13.391949 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fe6d7e05-2b61-4793-8dfc-67197810e30f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:13.392825 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fe6d7e05-2b61-4793-8dfc-67197810e30f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:13.394779 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fe6d7e05-2b61-4793-8dfc-67197810e30f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:13.395673 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fe6d7e05-2b61-4793-8dfc-67197810e30f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:13.396872 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fe6d7e05-2b61-4793-8dfc-67197810e30f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:13.417499 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-934eef9b-8cc0-4e21-a783-e9eae77744ef tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.094821 Aug 08 16:59:13.419080 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 448/908] 10.222.0.13 () {60 vars in 1343 bytes} [Mon Aug 8 16:59:13 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:13.429924 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-d98574be-d4ec-4d98-b96e-6fc2cd780867 req-773f6a0a-20e9-401e-afe5-28b525e79879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af731dd6-88e0-49bd-b38b-3b629bf771bb", "name": "network-vif-deleted", "tag": "9c64ef7c-063c-4f76-93a2-991e5526c905"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:13.442791 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-d98574be-d4ec-4d98-b96e-6fc2cd780867 req-773f6a0a-20e9-401e-afe5-28b525e79879 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:13.443356 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-d98574be-d4ec-4d98-b96e-6fc2cd780867 req-773f6a0a-20e9-401e-afe5-28b525e79879 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:13.444027 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-d98574be-d4ec-4d98-b96e-6fc2cd780867 req-773f6a0a-20e9-401e-afe5-28b525e79879 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:13.460448 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-d98574be-d4ec-4d98-b96e-6fc2cd780867 req-773f6a0a-20e9-401e-afe5-28b525e79879 service nova] Creating event network-vif-deleted:9c64ef7c-063c-4f76-93a2-991e5526c905 for instance af731dd6-88e0-49bd-b38b-3b629bf771bb on hv-cinder-85220 Aug 08 16:59:13.467911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-d98574be-d4ec-4d98-b96e-6fc2cd780867 req-773f6a0a-20e9-401e-afe5-28b525e79879 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046829 Aug 08 16:59:13.473450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 449/909] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:13.529800 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-33f442be-a58a-42cb-9525-33b6d3a30982 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:13.530487 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-33f442be-a58a-42cb-9525-33b6d3a30982 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:13.538237 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-33f442be-a58a-42cb-9525-33b6d3a30982 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:13.545083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-33f442be-a58a-42cb-9525-33b6d3a30982 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:13.545083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-33f442be-a58a-42cb-9525-33b6d3a30982 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:13.545083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-33f442be-a58a-42cb-9525-33b6d3a30982 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:13.545083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-33f442be-a58a-42cb-9525-33b6d3a30982 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:13.545773 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-33f442be-a58a-42cb-9525-33b6d3a30982 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:13.574803 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-33f442be-a58a-42cb-9525-33b6d3a30982 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Going to try to terminate instance {{(pid=130235) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:59:13.597547 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fe6d7e05-2b61-4793-8dfc-67197810e30f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:13.608948 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fe6d7e05-2b61-4793-8dfc-67197810e30f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1260 microversion: 2.1 time: 0.230359 Aug 08 16:59:13.609887 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 461/910] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:13 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:13.694616 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0b9778fe-fb55-46a4-8cc8-5279c528a2e6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:13.696482 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0b9778fe-fb55-46a4-8cc8-5279c528a2e6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:13.708895 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b9778fe-fb55-46a4-8cc8-5279c528a2e6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:13.710148 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b9778fe-fb55-46a4-8cc8-5279c528a2e6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:13.711138 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b9778fe-fb55-46a4-8cc8-5279c528a2e6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:13.712748 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b9778fe-fb55-46a4-8cc8-5279c528a2e6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:13.713902 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b9778fe-fb55-46a4-8cc8-5279c528a2e6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:13.714663 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0b9778fe-fb55-46a4-8cc8-5279c528a2e6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:13.829045 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0b9778fe-fb55-46a4-8cc8-5279c528a2e6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:13.845434 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0b9778fe-fb55-46a4-8cc8-5279c528a2e6 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1329 microversion: 2.1 time: 0.158816 Aug 08 16:59:13.847883 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 462/911] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:13 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1329 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:59:13.974975 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-33f442be-a58a-42cb-9525-33b6d3a30982 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 204 len: 0 microversion: 2.20 time: 0.449333 Aug 08 16:59:13.977785 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 450/912] 10.222.0.13 () {60 vars in 1280 bytes} [Mon Aug 8 16:59:13 2022] DELETE /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 16:59:13.987704 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c94c8db7-9be4-423a-bb95-d43bdf9fcb23 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:13.989091 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c94c8db7-9be4-423a-bb95-d43bdf9fcb23 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:13.997227 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c94c8db7-9be4-423a-bb95-d43bdf9fcb23 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:13.997728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c94c8db7-9be4-423a-bb95-d43bdf9fcb23 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:13.998165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c94c8db7-9be4-423a-bb95-d43bdf9fcb23 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:13.998930 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c94c8db7-9be4-423a-bb95-d43bdf9fcb23 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:14.006095 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c94c8db7-9be4-423a-bb95-d43bdf9fcb23 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:14.006595 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c94c8db7-9be4-423a-bb95-d43bdf9fcb23 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:14.211573 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c94c8db7-9be4-423a-bb95-d43bdf9fcb23 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:14.219995 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c94c8db7-9be4-423a-bb95-d43bdf9fcb23 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:14.222151 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c94c8db7-9be4-423a-bb95-d43bdf9fcb23 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:14.224563 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c94c8db7-9be4-423a-bb95-d43bdf9fcb23 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.244125 Aug 08 16:59:14.225298 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 463/913] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:13 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:59:14.634440 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6b78b228-1787-4dec-9df8-8bac954c6d99 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:14.635446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6b78b228-1787-4dec-9df8-8bac954c6d99 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:14.644223 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6b78b228-1787-4dec-9df8-8bac954c6d99 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:14.644882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6b78b228-1787-4dec-9df8-8bac954c6d99 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:14.645423 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6b78b228-1787-4dec-9df8-8bac954c6d99 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:14.646365 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6b78b228-1787-4dec-9df8-8bac954c6d99 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:14.646972 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6b78b228-1787-4dec-9df8-8bac954c6d99 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:14.647471 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6b78b228-1787-4dec-9df8-8bac954c6d99 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:14.823908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-6b78b228-1787-4dec-9df8-8bac954c6d99 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:14.832155 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-6b78b228-1787-4dec-9df8-8bac954c6d99 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1260 microversion: 2.1 time: 0.203836 Aug 08 16:59:14.832747 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 451/914] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:14 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:14.877491 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:14.878126 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:14.885806 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:14.886366 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:14.886884 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:14.887627 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:14.888095 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:14.888522 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:14.928177 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:14.928671 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:14.929114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:14.929580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lazy-loading 'fault' on Instance uuid af731dd6-88e0-49bd-b38b-3b629bf771bb {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:59:14.985183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:14.996977 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f5140051-0be2-456f-8fb1-8b558fcf1cbf tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1334 microversion: 2.1 time: 0.123263 Aug 08 16:59:14.998138 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 464/915] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:14 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1334 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:15.249407 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-44841138-f102-452d-8a11-b44fbe26fe15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:15.250148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-44841138-f102-452d-8a11-b44fbe26fe15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:15.257867 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44841138-f102-452d-8a11-b44fbe26fe15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:15.258682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44841138-f102-452d-8a11-b44fbe26fe15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:15.259414 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44841138-f102-452d-8a11-b44fbe26fe15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:15.260449 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44841138-f102-452d-8a11-b44fbe26fe15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:15.261037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44841138-f102-452d-8a11-b44fbe26fe15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:15.261588 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44841138-f102-452d-8a11-b44fbe26fe15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:15.435764 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-44841138-f102-452d-8a11-b44fbe26fe15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:15.446033 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-44841138-f102-452d-8a11-b44fbe26fe15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:15.447531 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-44841138-f102-452d-8a11-b44fbe26fe15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:15.448745 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-44841138-f102-452d-8a11-b44fbe26fe15 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.204132 Aug 08 16:59:15.449333 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 452/916] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:15 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:15.854100 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-67c93091-3c8d-4ec3-a05c-b03ea6d1d683 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:15.854642 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-67c93091-3c8d-4ec3-a05c-b03ea6d1d683 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:15.861584 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67c93091-3c8d-4ec3-a05c-b03ea6d1d683 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:15.862189 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67c93091-3c8d-4ec3-a05c-b03ea6d1d683 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:15.863387 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67c93091-3c8d-4ec3-a05c-b03ea6d1d683 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:15.864250 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67c93091-3c8d-4ec3-a05c-b03ea6d1d683 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:15.864801 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67c93091-3c8d-4ec3-a05c-b03ea6d1d683 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:15.865312 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-67c93091-3c8d-4ec3-a05c-b03ea6d1d683 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:15.877089 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5304a810-77ff-4e4f-af53-dfc451c5249d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:15.877989 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5304a810-77ff-4e4f-af53-dfc451c5249d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:15.886248 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5304a810-77ff-4e4f-af53-dfc451c5249d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:15.886919 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5304a810-77ff-4e4f-af53-dfc451c5249d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:15.887468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5304a810-77ff-4e4f-af53-dfc451c5249d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:15.888305 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5304a810-77ff-4e4f-af53-dfc451c5249d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:15.888952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5304a810-77ff-4e4f-af53-dfc451c5249d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:15.889547 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5304a810-77ff-4e4f-af53-dfc451c5249d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:15.918449 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5304a810-77ff-4e4f-af53-dfc451c5249d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/ips" status: 200 len: 149 microversion: 2.1 time: 0.045481 Aug 08 16:59:15.919728 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 453/917] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Aug 8 16:59:15 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:16.021289 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:16.022131 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:16.029626 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:16.030118 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:16.030558 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:16.031392 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:16.031850 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:16.032275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:16.072581 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:16.073339 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:16.073925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:16.074606 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lazy-loading 'fault' on Instance uuid af731dd6-88e0-49bd-b38b-3b629bf771bb {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:59:16.093595 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-67c93091-3c8d-4ec3-a05c-b03ea6d1d683 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:16.106364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-67c93091-3c8d-4ec3-a05c-b03ea6d1d683 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1260 microversion: 2.1 time: 0.255788 Aug 08 16:59:16.108173 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 465/918] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:15 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1260 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:16.122096 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:16.134493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-22d8b1fa-b659-4e9c-adfa-6e37aefeeb7b tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 200 len: 1334 microversion: 2.1 time: 0.117400 Aug 08 16:59:16.135591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 454/919] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:16 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 1334 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:16.474520 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ae5f2984-130f-4afa-98b2-e2a02396eaed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:16.483865 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ae5f2984-130f-4afa-98b2-e2a02396eaed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:16.494538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae5f2984-130f-4afa-98b2-e2a02396eaed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:16.495984 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae5f2984-130f-4afa-98b2-e2a02396eaed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:16.496710 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae5f2984-130f-4afa-98b2-e2a02396eaed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:16.498027 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae5f2984-130f-4afa-98b2-e2a02396eaed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:16.498926 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae5f2984-130f-4afa-98b2-e2a02396eaed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:16.499720 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ae5f2984-130f-4afa-98b2-e2a02396eaed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:16.554997 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-a769fb28-22c3-4208-b329-87975eb6c569 req-0e3041c7-7502-461a-9944-8c49bafa8a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff2191f-71f9-44b6-ae73-7e7385c80748", "name": "network-vif-plugged", "status": "completed", "tag": "c2eba598-5d72-4cf8-b348-8af93d348bb8"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:16.593554 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-a769fb28-22c3-4208-b329-87975eb6c569 req-0e3041c7-7502-461a-9944-8c49bafa8a08 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:16.594477 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-a769fb28-22c3-4208-b329-87975eb6c569 req-0e3041c7-7502-461a-9944-8c49bafa8a08 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:16.595353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-a769fb28-22c3-4208-b329-87975eb6c569 req-0e3041c7-7502-461a-9944-8c49bafa8a08 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:16.621088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-a769fb28-22c3-4208-b329-87975eb6c569 req-0e3041c7-7502-461a-9944-8c49bafa8a08 service nova] Creating event network-vif-plugged:c2eba598-5d72-4cf8-b348-8af93d348bb8 for instance eff2191f-71f9-44b6-ae73-7e7385c80748 on hv-cinder-85220 Aug 08 16:59:16.632710 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-a769fb28-22c3-4208-b329-87975eb6c569 req-0e3041c7-7502-461a-9944-8c49bafa8a08 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082073 Aug 08 16:59:16.633794 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 455/920] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:16.757213 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ae5f2984-130f-4afa-98b2-e2a02396eaed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:16.772527 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ae5f2984-130f-4afa-98b2-e2a02396eaed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:16.774270 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ae5f2984-130f-4afa-98b2-e2a02396eaed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:16.776627 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ae5f2984-130f-4afa-98b2-e2a02396eaed tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1723 microversion: 2.20 time: 0.306942 Aug 08 16:59:16.777664 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 466/921] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:16 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:59:17.148359 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6378f7f3-4908-41f5-bf9f-051465bda767 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:17.150725 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6378f7f3-4908-41f5-bf9f-051465bda767 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:17.157673 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3818c240-99fa-4568-8552-b5ba16d743fb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:17.158635 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3818c240-99fa-4568-8552-b5ba16d743fb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: af731dd6-88e0-49bd-b38b-3b629bf771bb] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:17.164855 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6378f7f3-4908-41f5-bf9f-051465bda767 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:17.165719 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6378f7f3-4908-41f5-bf9f-051465bda767 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:17.166515 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6378f7f3-4908-41f5-bf9f-051465bda767 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:17.167752 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6378f7f3-4908-41f5-bf9f-051465bda767 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:17.168556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6378f7f3-4908-41f5-bf9f-051465bda767 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:17.169345 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6378f7f3-4908-41f5-bf9f-051465bda767 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:17.171692 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3818c240-99fa-4568-8552-b5ba16d743fb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:17.173133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3818c240-99fa-4568-8552-b5ba16d743fb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:17.174068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3818c240-99fa-4568-8552-b5ba16d743fb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:17.176359 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3818c240-99fa-4568-8552-b5ba16d743fb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:17.177399 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3818c240-99fa-4568-8552-b5ba16d743fb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:17.178512 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3818c240-99fa-4568-8552-b5ba16d743fb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:17.214408 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-3818c240-99fa-4568-8552-b5ba16d743fb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] HTTP exception thrown: Instance af731dd6-88e0-49bd-b38b-3b629bf771bb could not be found. Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3818c240-99fa-4568-8552-b5ba16d743fb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Request method failure captured: Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb HTTP/1.1 Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T8w-K7laAEb2eqcpAcIQgFUL6kuL4XLbKHs4o9M-2KdcOOU83uXV2cxJjak-BJlSZljXiBu3GBNqSP4Yv2wtKGu8Kt7fn3jcSbSzg6UkIEqkYSp3Fw6_bcPoQdHG8VL8tlrNTQRdwt7oFp1kxR960UJj4ylfDEF571Gojp3_bb3VaQ Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: 6cac5ca5a8b04bce9a9d8ac938cd35e8 Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 16:59:17.218511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 16:59:17.220309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6cac5ca5a8b04bce9a9d8ac938cd35e8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:59:17.220309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:59:17.220309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: 6cac5ca5a8b04bce9a9d8ac938cd35e8 Aug 08 16:59:17.220309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:59:17.220309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-ServerRescueNegativeTestJSON-1491888347-project Aug 08 16:59:17.220309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 16:59:17.220309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 16:59:17.220309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: 75d793a42ec74232899b7a19e36b5867 Aug 08 16:59:17.220309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491888347-project Aug 08 16:59:17.220309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 16:59:17.220309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance af731dd6-88e0-49bd-b38b-3b629bf771bb could not be found. Aug 08 16:59:17.220309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': 'af731dd6-88e0-49bd-b38b-3b629bf771bb'} Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af731dd6-88e0-49bd-b38b-3b629bf771bb could not be found. Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:59:17.222766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af731dd6-88e0-49bd-b38b-3b629bf771bb could not be found. Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af731dd6-88e0-49bd-b38b-3b629bf771bb could not be found. Aug 08 16:59:17.224313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 16:59:17.226886 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3818c240-99fa-4568-8552-b5ba16d743fb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Returning 404 to user: Instance af731dd6-88e0-49bd-b38b-3b629bf771bb could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:59:17.228300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3818c240-99fa-4568-8552-b5ba16d743fb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb" status: 404 len: 111 microversion: 2.1 time: 0.075530 Aug 08 16:59:17.229068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 467/922] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:17 2022] GET /compute/v2.1/servers/af731dd6-88e0-49bd-b38b-3b629bf771bb => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:59:17.240369 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ceeb2752-5380-4cd6-9df2-94ce9cf39071 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '.version_select at 0x7f501a93b0d0>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:17.371233 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ceeb2752-5380-4cd6-9df2-94ce9cf39071 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-281708243" status: 202 len: 0 microversion: 2.1 time: 0.135676 Aug 08 16:59:17.372322 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 468/923] 10.222.0.13 () {58 vars in 1218 bytes} [Mon Aug 8 16:59:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-281708243 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 16:59:17.588920 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-6378f7f3-4908-41f5-bf9f-051465bda767 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:17.599324 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-6378f7f3-4908-41f5-bf9f-051465bda767 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1260 microversion: 2.1 time: 0.460497 Aug 08 16:59:17.600036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 456/924] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:17 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1260 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:17.740995 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1506bafa-4a75-49e2-99d6-5b54eb46e0a1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa78d622-462d-4298-9a61-50207b22700c"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:17.742426 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1506bafa-4a75-49e2-99d6-5b54eb46e0a1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:17.749884 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1506bafa-4a75-49e2-99d6-5b54eb46e0a1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:17.750391 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1506bafa-4a75-49e2-99d6-5b54eb46e0a1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:17.750855 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1506bafa-4a75-49e2-99d6-5b54eb46e0a1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:17.751589 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1506bafa-4a75-49e2-99d6-5b54eb46e0a1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:17.752053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1506bafa-4a75-49e2-99d6-5b54eb46e0a1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:17.752473 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1506bafa-4a75-49e2-99d6-5b54eb46e0a1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:17.801962 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3010c364-a628-4351-89d1-438ef8d2c632 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:17.802553 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-3010c364-a628-4351-89d1-438ef8d2c632 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:17.809278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3010c364-a628-4351-89d1-438ef8d2c632 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:17.809771 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3010c364-a628-4351-89d1-438ef8d2c632 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:17.812147 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3010c364-a628-4351-89d1-438ef8d2c632 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:17.812147 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3010c364-a628-4351-89d1-438ef8d2c632 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:17.812147 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3010c364-a628-4351-89d1-438ef8d2c632 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:17.812147 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3010c364-a628-4351-89d1-438ef8d2c632 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:17.911154 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-3010c364-a628-4351-89d1-438ef8d2c632 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:17.933502 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-3010c364-a628-4351-89d1-438ef8d2c632 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:17.937418 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-3010c364-a628-4351-89d1-438ef8d2c632 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:17.938726 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-3010c364-a628-4351-89d1-438ef8d2c632 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1656 microversion: 2.20 time: 0.141073 Aug 08 16:59:17.939548 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 457/925] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:17 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1656 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:59:18.460938 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-b54fc859-75f9-4fe8-a1f3-8b4e03b88927 req-67241c3b-b2e0-4610-a8ec-c4f6f3606eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70c7402-29f3-48b0-b5fc-dd586f6e4266", "name": "network-vif-deleted", "tag": "ee6f4872-65bc-467b-9551-24824a3b32ad"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:18.472620 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b54fc859-75f9-4fe8-a1f3-8b4e03b88927 req-67241c3b-b2e0-4610-a8ec-c4f6f3606eaa service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:18.473416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b54fc859-75f9-4fe8-a1f3-8b4e03b88927 req-67241c3b-b2e0-4610-a8ec-c4f6f3606eaa service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:18.474348 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b54fc859-75f9-4fe8-a1f3-8b4e03b88927 req-67241c3b-b2e0-4610-a8ec-c4f6f3606eaa service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:18.488145 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-b54fc859-75f9-4fe8-a1f3-8b4e03b88927 req-67241c3b-b2e0-4610-a8ec-c4f6f3606eaa service nova] Creating event network-vif-deleted:ee6f4872-65bc-467b-9551-24824a3b32ad for instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 on hv-cinder-85220 Aug 08 16:59:18.493854 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-b54fc859-75f9-4fe8-a1f3-8b4e03b88927 req-67241c3b-b2e0-4610-a8ec-c4f6f3606eaa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038073 Aug 08 16:59:18.494830 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 458/926] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:18.625335 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0c9c7cc0-603d-47dd-81d0-52377aebe969 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:18.626014 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0c9c7cc0-603d-47dd-81d0-52377aebe969 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:18.642730 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0c9c7cc0-603d-47dd-81d0-52377aebe969 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:18.643495 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0c9c7cc0-603d-47dd-81d0-52377aebe969 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:18.644174 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0c9c7cc0-603d-47dd-81d0-52377aebe969 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:18.645153 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0c9c7cc0-603d-47dd-81d0-52377aebe969 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:18.645628 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0c9c7cc0-603d-47dd-81d0-52377aebe969 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:18.646082 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0c9c7cc0-603d-47dd-81d0-52377aebe969 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:18.663394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:18.861753 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0c9c7cc0-603d-47dd-81d0-52377aebe969 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:18.871449 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0c9c7cc0-603d-47dd-81d0-52377aebe969 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1260 microversion: 2.1 time: 0.250511 Aug 08 16:59:18.885197 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 459/927] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:18 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:59:18.975118 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:18.975675 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:18.983211 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:18.983562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:18.984378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:18.985309 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:18.985974 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:18.986686 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:19.029489 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:19.030305 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:19.030960 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:19.031942 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lazy-loading 'fault' on Instance uuid f70c7402-29f3-48b0-b5fc-dd586f6e4266 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:59:19.084115 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:19.093049 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:19.094748 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:19.095982 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c79b929d-5d87-4be4-890d-5c511dc90ba4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1372 microversion: 2.20 time: 0.126467 Aug 08 16:59:19.097391 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 460/928] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:18 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1372 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:59:19.320440 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1506bafa-4a75-49e2-99d6-5b54eb46e0a1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "POST /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.584748 Aug 08 16:59:19.328965 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 469/929] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 16:59:17 2022] POST /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-volume_attachments => generated 194 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:19.894328 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5fa3574e-7644-490d-9cba-0c05a3272317 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:19.895186 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5fa3574e-7644-490d-9cba-0c05a3272317 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:19.902796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5fa3574e-7644-490d-9cba-0c05a3272317 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:19.903564 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5fa3574e-7644-490d-9cba-0c05a3272317 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:19.904017 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5fa3574e-7644-490d-9cba-0c05a3272317 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:19.904743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5fa3574e-7644-490d-9cba-0c05a3272317 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:19.905191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5fa3574e-7644-490d-9cba-0c05a3272317 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:19.905791 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5fa3574e-7644-490d-9cba-0c05a3272317 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:20.067287 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5fa3574e-7644-490d-9cba-0c05a3272317 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:20.077247 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5fa3574e-7644-490d-9cba-0c05a3272317 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1443 microversion: 2.1 time: 0.187848 Aug 08 16:59:20.077969 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 461/930] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:19 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1443 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:20.104314 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fedb444e-1d8f-45e4-863d-0e70f787df7d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:20.105295 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fedb444e-1d8f-45e4-863d-0e70f787df7d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:20.114669 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fedb444e-1d8f-45e4-863d-0e70f787df7d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:20.115344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fedb444e-1d8f-45e4-863d-0e70f787df7d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:20.116304 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fedb444e-1d8f-45e4-863d-0e70f787df7d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:20.117512 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fedb444e-1d8f-45e4-863d-0e70f787df7d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:20.118287 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fedb444e-1d8f-45e4-863d-0e70f787df7d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:20.119029 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fedb444e-1d8f-45e4-863d-0e70f787df7d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:20.124584 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:20.125656 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:20.136286 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:20.137107 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:20.137853 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:20.139290 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:20.140245 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:20.140955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:20.150723 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:20.198381 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:20.199324 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:20.199785 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:20.200269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lazy-loading 'fault' on Instance uuid f70c7402-29f3-48b0-b5fc-dd586f6e4266 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:59:20.263748 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:20.274459 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:20.276383 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:20.278532 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e0a19a21-e0dc-4132-b147-7863cfc2bd1c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 200 len: 1372 microversion: 2.20 time: 0.161209 Aug 08 16:59:20.287981 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 462/931] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:20 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:20.372742 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fedb444e-1d8f-45e4-863d-0e70f787df7d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:20.384961 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fedb444e-1d8f-45e4-863d-0e70f787df7d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1443 microversion: 2.1 time: 0.285336 Aug 08 16:59:20.386479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 470/932] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:20 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1443 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:21.303273 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a998134e-3e90-4e6c-8aa5-e9cc30894878 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:21.304037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a998134e-3e90-4e6c-8aa5-e9cc30894878 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:21.311325 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a998134e-3e90-4e6c-8aa5-e9cc30894878 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:21.311890 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a998134e-3e90-4e6c-8aa5-e9cc30894878 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:21.312280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a998134e-3e90-4e6c-8aa5-e9cc30894878 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:21.313094 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a998134e-3e90-4e6c-8aa5-e9cc30894878 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:21.313559 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a998134e-3e90-4e6c-8aa5-e9cc30894878 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:21.314012 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a998134e-3e90-4e6c-8aa5-e9cc30894878 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:21.330040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-a998134e-3e90-4e6c-8aa5-e9cc30894878 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] HTTP exception thrown: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a998134e-3e90-4e6c-8aa5-e9cc30894878 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Request method failure captured: Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 HTTP/1.1 Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T-qHEW5gtF_z_blI6_jMAax_vRxliY0Q56FiNYDN4NkCuuFAcrjnwor1xY-vGTtkLZjvhqgku68WoX2LWEduc4W_d1eP6aO9T4VR-FAaFFQpnUWBB74m2aCR0DHY2Mp7064IcLbG1BFQ9KDn8-_t4c7DvNUSsmyiL6QIDJUvs68iBg Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: fa4be8df3fe34d71a3c3d91995c1edae Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:59:21.332092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:59:21.334994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4be8df3fe34d71a3c3d91995c1edae", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:59:21.334994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 16:59:21.334994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: fa4be8df3fe34d71a3c3d91995c1edae Aug 08 16:59:21.334994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 16:59:21.334994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeShelveTestJSON-30285975-project Aug 08 16:59:21.334994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:59:21.334994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:59:21.334994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: d6d78cbc233a498db3a9268a4b93d737 Aug 08 16:59:21.334994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeShelveTestJSON-30285975-project Aug 08 16:59:21.334994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:59:21.334994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 16:59:21.334994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'f70c7402-29f3-48b0-b5fc-dd586f6e4266'} Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:59:21.336744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 16:59:21.340070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:21.342278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a998134e-3e90-4e6c-8aa5-e9cc30894878 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Returning 404 to user: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:59:21.342278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a998134e-3e90-4e6c-8aa5-e9cc30894878 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 404 len: 111 microversion: 2.20 time: 0.035478 Aug 08 16:59:21.342278 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 463/933] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:21 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 08 16:59:21.346248 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a11d3007-a81c-471f-9951-fdb6a4c1bae9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '.version_select at 0x7f501a8f0d30>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:21.437069 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a11d3007-a81c-471f-9951-fdb6a4c1bae9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008876410" status: 204 len: 0 microversion: 2.20 time: 0.096343 Aug 08 16:59:21.438015 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 471/934] 10.222.0.13 () {60 vars in 1262 bytes} [Mon Aug 8 16:59:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008876410 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 16:59:21.506468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-dcfc6ca4-45c2-4797-ad36-3015384cf203 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:21.507929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-dcfc6ca4-45c2-4797-ad36-3015384cf203 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:21.516580 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dcfc6ca4-45c2-4797-ad36-3015384cf203 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:21.517379 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dcfc6ca4-45c2-4797-ad36-3015384cf203 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:21.518378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dcfc6ca4-45c2-4797-ad36-3015384cf203 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:21.519681 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dcfc6ca4-45c2-4797-ad36-3015384cf203 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:21.520399 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dcfc6ca4-45c2-4797-ad36-3015384cf203 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:21.521020 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dcfc6ca4-45c2-4797-ad36-3015384cf203 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:21.577240 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-dcfc6ca4-45c2-4797-ad36-3015384cf203 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Going to try to terminate instance {{(pid=130235) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:59:21.848708 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fa2bf891-7272-494f-97fe-c12f7fef5e48 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1678905078"}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:21.852294 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fa2bf891-7272-494f-97fe-c12f7fef5e48 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:21.873875 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fa2bf891-7272-494f-97fe-c12f7fef5e48 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:21.873875 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fa2bf891-7272-494f-97fe-c12f7fef5e48 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:21.873875 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fa2bf891-7272-494f-97fe-c12f7fef5e48 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:21.873875 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fa2bf891-7272-494f-97fe-c12f7fef5e48 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:21.875104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fa2bf891-7272-494f-97fe-c12f7fef5e48 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:21.875104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fa2bf891-7272-494f-97fe-c12f7fef5e48 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:21.990594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-dcfc6ca4-45c2-4797-ad36-3015384cf203 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 204 len: 0 microversion: 2.1 time: 0.489954 Aug 08 16:59:21.991386 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 464/935] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:59:21 2022] DELETE /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 16:59:22.001687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-76f1ae15-313a-4bd6-b75b-8ca71a234e80 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:22.002347 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-76f1ae15-313a-4bd6-b75b-8ca71a234e80 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:22.009941 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76f1ae15-313a-4bd6-b75b-8ca71a234e80 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:22.010439 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76f1ae15-313a-4bd6-b75b-8ca71a234e80 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:22.011236 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76f1ae15-313a-4bd6-b75b-8ca71a234e80 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:22.012025 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76f1ae15-313a-4bd6-b75b-8ca71a234e80 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:22.012404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76f1ae15-313a-4bd6-b75b-8ca71a234e80 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:22.013171 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-76f1ae15-313a-4bd6-b75b-8ca71a234e80 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:22.311180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-76f1ae15-313a-4bd6-b75b-8ca71a234e80 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:22.352253 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-76f1ae15-313a-4bd6-b75b-8ca71a234e80 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1508 microversion: 2.1 time: 0.355551 Aug 08 16:59:22.353850 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 465/936] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:21 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1508 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:59:22.422944 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.network.security_group_api [None req-fa2bf891-7272-494f-97fe-c12f7fef5e48 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Removing security group 2698715e-7877-4e27-89ab-81c6c39ec37d from port e664734d-6d99-473f-9417-434a305e356c Aug 08 16:59:22.847102 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e94e8f58-56ae-4881-be32-3c5fa791b20a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Action: 'create', calling method: .version_select at 0x7f50161904c0>, body: {"keypair": {"name": "tempest-keypair-976051337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTOzjRjh0aFx9KKcFK5huWp6ou0rEUjkw65j7dvvDTE92G/HiAdYslsDdcuLLIQu8AvcyH+BfhUS0ByO+tJG+lWdFwqLcrJVPTzQ2i3AzlJBzDpDcYHNrMAl+1uYDhp6w=="}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:22.870940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-e94e8f58-56ae-4881-be32-3c5fa791b20a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Getting quotas for project fa4be8df3fe34d71a3c3d91995c1edae. Resources: {'key_pairs'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:59:22.879493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-e94e8f58-56ae-4881-be32-3c5fa791b20a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Getting quotas for user d6d78cbc233a498db3a9268a4b93d737 and project fa4be8df3fe34d71a3c3d91995c1edae. Resources: {'key_pairs'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:59:22.977504 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e94e8f58-56ae-4881-be32-3c5fa791b20a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.135141 Aug 08 16:59:22.978945 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 466/937] 10.222.0.13 () {62 vars in 1200 bytes} [Mon Aug 8 16:59:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 08 16:59:23.093557 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fa2bf891-7272-494f-97fe-c12f7fef5e48 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "POST /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/action" status: 202 len: 0 microversion: 2.1 time: 1.253464 Aug 08 16:59:23.102238 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 472/938] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 16:59:21 2022] POST /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/action => generated 0 bytes in 1264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 16:59:23.115907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-7e5eeac0-4ee3-4d5a-a3f4-7418aba60fb4 req-4dcddbc6-1198-4c18-81c3-7a02e8d66df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "173f1a4f-1673-4644-8730-67eaf9df2b61", "tag": "e664734d-6d99-473f-9417-434a305e356c"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:23.146876 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-7e5eeac0-4ee3-4d5a-a3f4-7418aba60fb4 req-4dcddbc6-1198-4c18-81c3-7a02e8d66df1 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:23.150194 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-7e5eeac0-4ee3-4d5a-a3f4-7418aba60fb4 req-4dcddbc6-1198-4c18-81c3-7a02e8d66df1 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:23.151369 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-7e5eeac0-4ee3-4d5a-a3f4-7418aba60fb4 req-4dcddbc6-1198-4c18-81c3-7a02e8d66df1 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:23.188468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-7e5eeac0-4ee3-4d5a-a3f4-7418aba60fb4 req-4dcddbc6-1198-4c18-81c3-7a02e8d66df1 service nova] Creating event network-changed:e664734d-6d99-473f-9417-434a305e356c for instance 173f1a4f-1673-4644-8730-67eaf9df2b61 on hv-cinder-85220 Aug 08 16:59:23.206975 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-7e5eeac0-4ee3-4d5a-a3f4-7418aba60fb4 req-4dcddbc6-1198-4c18-81c3-7a02e8d66df1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096902 Aug 08 16:59:23.209668 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 467/939] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:23.391751 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5e5d5089-692d-4bcb-b54f-080d3bafabf3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:23.397170 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5e5d5089-692d-4bcb-b54f-080d3bafabf3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:23.414333 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5e5d5089-692d-4bcb-b54f-080d3bafabf3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:23.417835 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5e5d5089-692d-4bcb-b54f-080d3bafabf3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:23.420911 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5e5d5089-692d-4bcb-b54f-080d3bafabf3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:23.422751 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5e5d5089-692d-4bcb-b54f-080d3bafabf3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:23.424132 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5e5d5089-692d-4bcb-b54f-080d3bafabf3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:23.428343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5e5d5089-692d-4bcb-b54f-080d3bafabf3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:23.757477 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-5e5d5089-692d-4bcb-b54f-080d3bafabf3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:23.772954 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5e5d5089-692d-4bcb-b54f-080d3bafabf3 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1508 microversion: 2.1 time: 0.392231 Aug 08 16:59:23.774539 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 473/940] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:23 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1508 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:24.152920 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-70bf114f-80ed-4fde-b314-8d4a6df16872 req-ad617a44-93d8-4e3b-b646-b344f7b7d91f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff2191f-71f9-44b6-ae73-7e7385c80748", "tag": "c2eba598-5d72-4cf8-b348-8af93d348bb8"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:24.188024 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-70bf114f-80ed-4fde-b314-8d4a6df16872 req-ad617a44-93d8-4e3b-b646-b344f7b7d91f service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:24.191061 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-70bf114f-80ed-4fde-b314-8d4a6df16872 req-ad617a44-93d8-4e3b-b646-b344f7b7d91f service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:24.192037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-70bf114f-80ed-4fde-b314-8d4a6df16872 req-ad617a44-93d8-4e3b-b646-b344f7b7d91f service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:24.229358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-70bf114f-80ed-4fde-b314-8d4a6df16872 req-ad617a44-93d8-4e3b-b646-b344f7b7d91f service nova] Creating event network-changed:c2eba598-5d72-4cf8-b348-8af93d348bb8 for instance eff2191f-71f9-44b6-ae73-7e7385c80748 on hv-cinder-85220 Aug 08 16:59:24.241463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-70bf114f-80ed-4fde-b314-8d4a6df16872 req-ad617a44-93d8-4e3b-b646-b344f7b7d91f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110331 Aug 08 16:59:24.243020 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 468/941] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:24.833980 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-80128159-bd2b-461e-acfe-5a371fb4e4a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:24.837329 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-80128159-bd2b-461e-acfe-5a371fb4e4a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:24.858876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80128159-bd2b-461e-acfe-5a371fb4e4a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:24.858876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80128159-bd2b-461e-acfe-5a371fb4e4a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:24.858876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80128159-bd2b-461e-acfe-5a371fb4e4a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:24.875458 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80128159-bd2b-461e-acfe-5a371fb4e4a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:24.876173 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80128159-bd2b-461e-acfe-5a371fb4e4a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:24.876639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-80128159-bd2b-461e-acfe-5a371fb4e4a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:25.034232 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-80128159-bd2b-461e-acfe-5a371fb4e4a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:25.045802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-80128159-bd2b-461e-acfe-5a371fb4e4a7 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 200 len: 1293 microversion: 2.1 time: 0.236454 Aug 08 16:59:25.059493 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 474/942] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:24 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 1293 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:26.109571 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2259262d-cfff-4167-9642-f3e64ccd6419 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:26.110331 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2259262d-cfff-4167-9642-f3e64ccd6419 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 9f523b07-1c20-4eab-a270-2e16b2895c14] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:26.118617 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2259262d-cfff-4167-9642-f3e64ccd6419 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.119523 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2259262d-cfff-4167-9642-f3e64ccd6419 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.119971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2259262d-cfff-4167-9642-f3e64ccd6419 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.120703 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2259262d-cfff-4167-9642-f3e64ccd6419 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.121190 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2259262d-cfff-4167-9642-f3e64ccd6419 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.121661 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2259262d-cfff-4167-9642-f3e64ccd6419 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.140713 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-2259262d-cfff-4167-9642-f3e64ccd6419 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] HTTP exception thrown: Instance 9f523b07-1c20-4eab-a270-2e16b2895c14 could not be found. Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2259262d-cfff-4167-9642-f3e64ccd6419 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Request method failure captured: Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 HTTP/1.1 Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8w-K7laAEb2eqcpAcIQgFUL6kuL4XLbKHs4o9M-2KdcOOU83uXV2cxJjak-BJlSZljXiBu3GBNqSP4Yv2wtKGu8Kt7fn3jcSbSzg6UkIEqkYSp3Fw6_bcPoQdHG8VL8tlrNTQRdwt7oFp1kxR960UJj4ylfDEF571Gojp3_bb3VaQ Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 6cac5ca5a8b04bce9a9d8ac938cd35e8 Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:59:26.142485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:59:26.144192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6cac5ca5a8b04bce9a9d8ac938cd35e8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:59:26.144192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:59:26.144192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 6cac5ca5a8b04bce9a9d8ac938cd35e8 Aug 08 16:59:26.144192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:59:26.144192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-ServerRescueNegativeTestJSON-1491888347-project Aug 08 16:59:26.144192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:59:26.144192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:59:26.144192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: 75d793a42ec74232899b7a19e36b5867 Aug 08 16:59:26.144192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491888347-project Aug 08 16:59:26.144192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:59:26.144192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 9f523b07-1c20-4eab-a270-2e16b2895c14 could not be found. Aug 08 16:59:26.144192 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '9f523b07-1c20-4eab-a270-2e16b2895c14'} Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f523b07-1c20-4eab-a270-2e16b2895c14 could not be found. Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:59:26.145088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f523b07-1c20-4eab-a270-2e16b2895c14 could not be found. Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f523b07-1c20-4eab-a270-2e16b2895c14 could not be found. Aug 08 16:59:26.146591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:26.148828 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2259262d-cfff-4167-9642-f3e64ccd6419 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Returning 404 to user: Instance 9f523b07-1c20-4eab-a270-2e16b2895c14 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:59:26.149889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2259262d-cfff-4167-9642-f3e64ccd6419 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14" status: 404 len: 111 microversion: 2.1 time: 0.055753 Aug 08 16:59:26.154620 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 469/943] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:26 2022] GET /compute/v2.1/servers/9f523b07-1c20-4eab-a270-2e16b2895c14 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:59:26.164954 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-716f62b1-8a6e-42e6-b571-bdeb381c6c71 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:26.165983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-716f62b1-8a6e-42e6-b571-bdeb381c6c71 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:26.178705 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-716f62b1-8a6e-42e6-b571-bdeb381c6c71 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.180118 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-716f62b1-8a6e-42e6-b571-bdeb381c6c71 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.181104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-716f62b1-8a6e-42e6-b571-bdeb381c6c71 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.182399 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-716f62b1-8a6e-42e6-b571-bdeb381c6c71 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.183903 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-716f62b1-8a6e-42e6-b571-bdeb381c6c71 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.184818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-716f62b1-8a6e-42e6-b571-bdeb381c6c71 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.236831 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-716f62b1-8a6e-42e6-b571-bdeb381c6c71 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:59:26.270528 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-caf368e6-4cf2-4886-b3f1-52d41ca177f9 req-24608208-b8c9-41e5-9e54-cf07fee8c885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f523b07-1c20-4eab-a270-2e16b2895c14", "name": "network-vif-deleted", "tag": "5f8c4a44-04d1-4ab7-bf9b-3e4a84483e8e"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:26.281907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-caf368e6-4cf2-4886-b3f1-52d41ca177f9 req-24608208-b8c9-41e5-9e54-cf07fee8c885 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.282770 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-caf368e6-4cf2-4886-b3f1-52d41ca177f9 req-24608208-b8c9-41e5-9e54-cf07fee8c885 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.283411 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-caf368e6-4cf2-4886-b3f1-52d41ca177f9 req-24608208-b8c9-41e5-9e54-cf07fee8c885 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.303545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-caf368e6-4cf2-4886-b3f1-52d41ca177f9 req-24608208-b8c9-41e5-9e54-cf07fee8c885 service nova] Creating event network-vif-deleted:5f8c4a44-04d1-4ab7-bf9b-3e4a84483e8e for instance 9f523b07-1c20-4eab-a270-2e16b2895c14 on hv-cinder-85220 Aug 08 16:59:26.310482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-caf368e6-4cf2-4886-b3f1-52d41ca177f9 req-24608208-b8c9-41e5-9e54-cf07fee8c885 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044552 Aug 08 16:59:26.312099 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 470/944] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:26.527788 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-46cb20d2-dc3e-45ff-a2e2-e287ead83424 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:26.528632 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-46cb20d2-dc3e-45ff-a2e2-e287ead83424 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:26.537631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-46cb20d2-dc3e-45ff-a2e2-e287ead83424 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.538490 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-46cb20d2-dc3e-45ff-a2e2-e287ead83424 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.539189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-46cb20d2-dc3e-45ff-a2e2-e287ead83424 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.540165 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-46cb20d2-dc3e-45ff-a2e2-e287ead83424 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.541127 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-46cb20d2-dc3e-45ff-a2e2-e287ead83424 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.541573 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-46cb20d2-dc3e-45ff-a2e2-e287ead83424 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.646710 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-716f62b1-8a6e-42e6-b571-bdeb381c6c71 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "DELETE /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 204 len: 0 microversion: 2.1 time: 0.489268 Aug 08 16:59:26.651336 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 475/945] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:59:26 2022] DELETE /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 16:59:26.657457 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-99c56bba-5a64-418e-b282-e514438b0ff8 req-6f857ec6-ba9e-481d-b1de-775fa06c3aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "173f1a4f-1673-4644-8730-67eaf9df2b61", "tag": "e664734d-6d99-473f-9417-434a305e356c"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:26.669599 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-99c56bba-5a64-418e-b282-e514438b0ff8 req-6f857ec6-ba9e-481d-b1de-775fa06c3aa1 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.670371 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-99c56bba-5a64-418e-b282-e514438b0ff8 req-6f857ec6-ba9e-481d-b1de-775fa06c3aa1 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.671054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-99c56bba-5a64-418e-b282-e514438b0ff8 req-6f857ec6-ba9e-481d-b1de-775fa06c3aa1 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.686131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-99c56bba-5a64-418e-b282-e514438b0ff8 req-6f857ec6-ba9e-481d-b1de-775fa06c3aa1 service nova] Creating event network-changed:e664734d-6d99-473f-9417-434a305e356c for instance 173f1a4f-1673-4644-8730-67eaf9df2b61 on hv-cinder-85220 Aug 08 16:59:26.692283 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-99c56bba-5a64-418e-b282-e514438b0ff8 req-6f857ec6-ba9e-481d-b1de-775fa06c3aa1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039060 Aug 08 16:59:26.692896 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 476/946] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:26.702367 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b9e99307-4582-4faa-a5ce-e751d593923f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:26.703456 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b9e99307-4582-4faa-a5ce-e751d593923f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:26.712890 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b9e99307-4582-4faa-a5ce-e751d593923f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.713722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b9e99307-4582-4faa-a5ce-e751d593923f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.714482 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b9e99307-4582-4faa-a5ce-e751d593923f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.715454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b9e99307-4582-4faa-a5ce-e751d593923f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:26.716130 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b9e99307-4582-4faa-a5ce-e751d593923f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:26.716805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b9e99307-4582-4faa-a5ce-e751d593923f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:26.721043 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-46cb20d2-dc3e-45ff-a2e2-e287ead83424 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lazy-loading 'services' on Instance uuid 173f1a4f-1673-4644-8730-67eaf9df2b61 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:59:27.018078 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b9e99307-4582-4faa-a5ce-e751d593923f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:27.027368 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b9e99307-4582-4faa-a5ce-e751d593923f tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.329992 Aug 08 16:59:27.027963 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 477/947] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:26 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:27.083453 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-69113507", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c74914b0-0404-42f3-ba1f-a87c87df5430"}], "security_groups": [{"name": "tempest-securitygroup--1981451241"}], "key_name": "tempest-keypair-976051337", "user_data": "}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:27.122890 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-46cb20d2-dc3e-45ff-a2e2-e287ead83424 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "DELETE /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments/917bd779-92cd-49b4-9b7e-053f9b3627a4" status: 202 len: 0 microversion: 2.1 time: 0.599767 Aug 08 16:59:27.124975 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 471/948] 10.222.0.13 () {58 vars in 1416 bytes} [Mon Aug 8 16:59:26 2022] DELETE /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments/917bd779-92cd-49b4-9b7e-053f9b3627a4 => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:59:27.147630 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d01655c1-982b-48f5-b00c-142747a96d5a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:27.151919 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d01655c1-982b-48f5-b00c-142747a96d5a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:27.165318 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d01655c1-982b-48f5-b00c-142747a96d5a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:27.168417 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d01655c1-982b-48f5-b00c-142747a96d5a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:27.168417 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d01655c1-982b-48f5-b00c-142747a96d5a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:27.168417 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d01655c1-982b-48f5-b00c-142747a96d5a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:27.168417 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d01655c1-982b-48f5-b00c-142747a96d5a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:27.169833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d01655c1-982b-48f5-b00c-142747a96d5a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:27.208727 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d01655c1-982b-48f5-b00c-142747a96d5a tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078243 Aug 08 16:59:27.211284 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 472/949] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:59:27 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:27.239648 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.network.neutron [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] validate_networks() for [('c74914b0-0404-42f3-ba1f-a87c87df5430', None, None, None, None, None)] {{(pid=130236) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:59:27.736051 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Flavor limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:59:27.736631 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Image limits 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:59:27.738350 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Flavor pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:59:27.739350 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Image pref 0:0:0 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:59:27.739726 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.virt.hardware [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130236) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:59:27.752133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:27.753904 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:27.754605 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:27.755498 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:27.756085 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:27.756636 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:27.777822 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Getting quotas for project fa4be8df3fe34d71a3c3d91995c1edae. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:59:27.782891 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Getting quotas for user d6d78cbc233a498db3a9268a4b93d737 and project fa4be8df3fe34d71a3c3d91995c1edae. Resources: {'instances', 'cores', 'ram'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:59:27.804441 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Going to run 1 instances... {{(pid=130236) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:59:27.807774 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130236) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:59:27.833190 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:27.988803 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-28a41e6d-8544-4a6f-be7f-2734c69def13 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.913897 Aug 08 16:59:27.989757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 478/950] 10.222.0.13 () {62 vars in 1188 bytes} [Mon Aug 8 16:59:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 08 16:59:28.000752 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-08dec521-48b8-4e12-b4ae-c1054a8683c7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:28.001377 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-08dec521-48b8-4e12-b4ae-c1054a8683c7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:28.067063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d1d3c8d8-1ca4-4a71-80be-5c20a52db3b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:28.068214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d1d3c8d8-1ca4-4a71-80be-5c20a52db3b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:28.077534 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-08dec521-48b8-4e12-b4ae-c1054a8683c7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:28.089515 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d1d3c8d8-1ca4-4a71-80be-5c20a52db3b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:28.089515 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d1d3c8d8-1ca4-4a71-80be-5c20a52db3b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:28.089515 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d1d3c8d8-1ca4-4a71-80be-5c20a52db3b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:28.089515 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d1d3c8d8-1ca4-4a71-80be-5c20a52db3b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:28.089946 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-08dec521-48b8-4e12-b4ae-c1054a8683c7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:28.090062 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d1d3c8d8-1ca4-4a71-80be-5c20a52db3b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:28.090062 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d1d3c8d8-1ca4-4a71-80be-5c20a52db3b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:28.090234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-08dec521-48b8-4e12-b4ae-c1054a8683c7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:28.090234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-08dec521-48b8-4e12-b4ae-c1054a8683c7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1279 microversion: 2.20 time: 0.092562 Aug 08 16:59:28.105666 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 473/951] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:27 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1279 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:28.226856 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b5844b23-0ed1-4d46-b2c2-cbba7986024e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:28.228772 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b5844b23-0ed1-4d46-b2c2-cbba7986024e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:28.251096 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b5844b23-0ed1-4d46-b2c2-cbba7986024e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:28.256928 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b5844b23-0ed1-4d46-b2c2-cbba7986024e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:28.257562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b5844b23-0ed1-4d46-b2c2-cbba7986024e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:28.258427 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b5844b23-0ed1-4d46-b2c2-cbba7986024e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:28.259515 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b5844b23-0ed1-4d46-b2c2-cbba7986024e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:28.260329 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b5844b23-0ed1-4d46-b2c2-cbba7986024e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:28.311831 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b5844b23-0ed1-4d46-b2c2-cbba7986024e tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093209 Aug 08 16:59:28.312941 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 474/952] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:59:28 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:28.526764 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d1d3c8d8-1ca4-4a71-80be-5c20a52db3b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:28.536396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d1d3c8d8-1ca4-4a71-80be-5c20a52db3b9 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1523 microversion: 2.1 time: 0.478672 Aug 08 16:59:28.537006 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 479/953] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:28 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1523 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:29.120644 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b641b6cc-21fc-4e01-bcec-d1e1fa8624aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:29.121432 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b641b6cc-21fc-4e01-bcec-d1e1fa8624aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:29.233474 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b641b6cc-21fc-4e01-bcec-d1e1fa8624aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:29.243001 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b641b6cc-21fc-4e01-bcec-d1e1fa8624aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:29.244545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b641b6cc-21fc-4e01-bcec-d1e1fa8624aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:29.245962 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b641b6cc-21fc-4e01-bcec-d1e1fa8624aa tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1279 microversion: 2.20 time: 0.134454 Aug 08 16:59:29.246874 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 475/954] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:29 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1279 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:29.328689 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f16909e2-9f44-4305-af19-41ffa46e5836 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:29.332393 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f16909e2-9f44-4305-af19-41ffa46e5836 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:29.349314 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f16909e2-9f44-4305-af19-41ffa46e5836 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:29.349314 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f16909e2-9f44-4305-af19-41ffa46e5836 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:29.349314 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f16909e2-9f44-4305-af19-41ffa46e5836 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:29.349314 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f16909e2-9f44-4305-af19-41ffa46e5836 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:29.349856 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f16909e2-9f44-4305-af19-41ffa46e5836 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:29.349856 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f16909e2-9f44-4305-af19-41ffa46e5836 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:29.381265 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f16909e2-9f44-4305-af19-41ffa46e5836 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057324 Aug 08 16:59:29.381764 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 480/955] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:59:29 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:29.444016 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-caf132d4-1453-46c9-a4e3-48f72612f3c8 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa78d622-462d-4298-9a61-50207b22700c"}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:29.446455 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-caf132d4-1453-46c9-a4e3-48f72612f3c8 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:29.456793 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-caf132d4-1453-46c9-a4e3-48f72612f3c8 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:29.457340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-caf132d4-1453-46c9-a4e3-48f72612f3c8 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:29.457787 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-caf132d4-1453-46c9-a4e3-48f72612f3c8 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:29.458519 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-caf132d4-1453-46c9-a4e3-48f72612f3c8 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:29.459012 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-caf132d4-1453-46c9-a4e3-48f72612f3c8 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:29.459595 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-caf132d4-1453-46c9-a4e3-48f72612f3c8 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:29.553374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-caf132d4-1453-46c9-a4e3-48f72612f3c8 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Invalid volume: volume aa78d622-462d-4298-9a61-50207b22700c is already attached to instances: d228b747-dc71-4145-bc09-820362dc7fc3 Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-caf132d4-1453-46c9-a4e3-48f72612f3c8 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: POST /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-volume_attachments HTTP/1.1 Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 74 Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:59:29.555106 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:59:29.557451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:59:29.557451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:59:29.557451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 16:59:29.557451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:59:29.557451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 16:59:29.557451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:59:29.557451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:59:29.557451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 16:59:29.557451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 16:59:29.557451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Aug 08 16:59:29.557451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {"volumeAttachment": {"volumeId": "aa78d622-462d-4298-9a61-50207b22700c"}} Aug 08 16:59:29.557451 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Invalid volume: volume aa78d622-462d-4298-9a61-50207b22700c is already attached to instances: d228b747-dc71-4145-bc09-820362dc7fc3 Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'server_id': 'd228b747-dc71-4145-bc09-820362dc7fc3', 'body': {'volumeAttachment': {'volumeId': 'aa78d622-462d-4298-9a61-50207b22700c'}}} Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aa78d622-462d-4298-9a61-50207b22700c is already attached to instances: d228b747-dc71-4145-bc09-820362dc7fc3 Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:29.558664 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aa78d622-462d-4298-9a61-50207b22700c is already attached to instances: d228b747-dc71-4145-bc09-820362dc7fc3 Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:29.568925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:29.571841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:29.571841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:59:29.571841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:59:29.571841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aa78d622-462d-4298-9a61-50207b22700c is already attached to instances: d228b747-dc71-4145-bc09-820362dc7fc3 Aug 08 16:59:29.571841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:29.571841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-caf132d4-1453-46c9-a4e3-48f72612f3c8 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 400 to user: Invalid volume: volume aa78d622-462d-4298-9a61-50207b22700c is already attached to instances: d228b747-dc71-4145-bc09-820362dc7fc3 {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:59:29.571841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-caf132d4-1453-46c9-a4e3-48f72612f3c8 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "POST /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117693 Aug 08 16:59:29.571841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 476/956] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 16:59:29 2022] POST /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 16:59:29.572558 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-391ba408-bb0b-43d6-aa35-6d7f23428dce tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:29.572558 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-391ba408-bb0b-43d6-aa35-6d7f23428dce tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:29.573409 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-391ba408-bb0b-43d6-aa35-6d7f23428dce tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:29.573409 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-391ba408-bb0b-43d6-aa35-6d7f23428dce tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:29.573851 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-391ba408-bb0b-43d6-aa35-6d7f23428dce tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:29.574453 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-391ba408-bb0b-43d6-aa35-6d7f23428dce tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:29.574951 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-391ba408-bb0b-43d6-aa35-6d7f23428dce tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:29.578726 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-391ba408-bb0b-43d6-aa35-6d7f23428dce tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:29.657389 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-391ba408-bb0b-43d6-aa35-6d7f23428dce tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:29.686439 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-391ba408-bb0b-43d6-aa35-6d7f23428dce tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1481 microversion: 2.1 time: 0.129725 Aug 08 16:59:29.686439 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 481/957] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:29 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1481 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:29.689877 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-21bb2955-c5b9-402b-96e7-6e46832de9f0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:29.691836 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-21bb2955-c5b9-402b-96e7-6e46832de9f0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:29.699581 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-21bb2955-c5b9-402b-96e7-6e46832de9f0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:29.700072 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-21bb2955-c5b9-402b-96e7-6e46832de9f0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:29.700501 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-21bb2955-c5b9-402b-96e7-6e46832de9f0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:29.701209 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-21bb2955-c5b9-402b-96e7-6e46832de9f0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:29.701871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-21bb2955-c5b9-402b-96e7-6e46832de9f0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:29.702295 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-21bb2955-c5b9-402b-96e7-6e46832de9f0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:29.755665 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-6a435998-2c5f-41a2-99d2-83eae9885d59 req-298f288b-b93e-4b2d-bdc4-8decc9c11b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65990fbf-4d36-42ed-8f3b-3406d373841a", "name": "network-vif-deleted", "tag": "aa00f426-38ee-4d32-8b5a-c76a247b3988"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:29.766542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-6a435998-2c5f-41a2-99d2-83eae9885d59 req-298f288b-b93e-4b2d-bdc4-8decc9c11b56 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:29.767074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-6a435998-2c5f-41a2-99d2-83eae9885d59 req-298f288b-b93e-4b2d-bdc4-8decc9c11b56 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:29.767513 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-6a435998-2c5f-41a2-99d2-83eae9885d59 req-298f288b-b93e-4b2d-bdc4-8decc9c11b56 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:29.781182 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-6a435998-2c5f-41a2-99d2-83eae9885d59 req-298f288b-b93e-4b2d-bdc4-8decc9c11b56 service nova] Creating event network-vif-deleted:aa00f426-38ee-4d32-8b5a-c76a247b3988 for instance 65990fbf-4d36-42ed-8f3b-3406d373841a on hv-cinder-85220 Aug 08 16:59:29.787664 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-6a435998-2c5f-41a2-99d2-83eae9885d59 req-298f288b-b93e-4b2d-bdc4-8decc9c11b56 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039126 Aug 08 16:59:29.788715 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 482/958] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:29.816590 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-21bb2955-c5b9-402b-96e7-6e46832de9f0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lazy-loading 'services' on Instance uuid d228b747-dc71-4145-bc09-820362dc7fc3 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:59:30.107105 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-21bb2955-c5b9-402b-96e7-6e46832de9f0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-volume_attachments/aa78d622-462d-4298-9a61-50207b22700c" status: 202 len: 0 microversion: 2.1 time: 0.419576 Aug 08 16:59:30.112510 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 477/959] 10.222.0.13 () {58 vars in 1416 bytes} [Mon Aug 8 16:59:29 2022] DELETE /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-volume_attachments/aa78d622-462d-4298-9a61-50207b22700c => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:59:30.121827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3878a694-1c54-4059-9ca7-e7b4c8e271a3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:30.125155 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3878a694-1c54-4059-9ca7-e7b4c8e271a3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:30.133077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3878a694-1c54-4059-9ca7-e7b4c8e271a3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:30.133578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3878a694-1c54-4059-9ca7-e7b4c8e271a3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:30.134019 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3878a694-1c54-4059-9ca7-e7b4c8e271a3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:30.134840 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3878a694-1c54-4059-9ca7-e7b4c8e271a3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:30.135301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3878a694-1c54-4059-9ca7-e7b4c8e271a3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:30.135726 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3878a694-1c54-4059-9ca7-e7b4c8e271a3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:30.184680 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3878a694-1c54-4059-9ca7-e7b4c8e271a3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067122 Aug 08 16:59:30.187620 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 483/960] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:59:30 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:30.275029 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9635c4b1-074f-474b-be02-2562d0fd59e7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:30.276336 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9635c4b1-074f-474b-be02-2562d0fd59e7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:30.279891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:30.289222 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9635c4b1-074f-474b-be02-2562d0fd59e7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:30.290283 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9635c4b1-074f-474b-be02-2562d0fd59e7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:30.294132 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9635c4b1-074f-474b-be02-2562d0fd59e7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:30.294132 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9635c4b1-074f-474b-be02-2562d0fd59e7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:30.294132 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9635c4b1-074f-474b-be02-2562d0fd59e7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:30.294132 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9635c4b1-074f-474b-be02-2562d0fd59e7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:30.395375 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-88256138-02a9-43c4-9b5b-cfd480f1eabd tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:30.397659 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-88256138-02a9-43c4-9b5b-cfd480f1eabd tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:30.400051 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9635c4b1-074f-474b-be02-2562d0fd59e7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:30.403912 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:30.413347 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-88256138-02a9-43c4-9b5b-cfd480f1eabd tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:30.413347 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-88256138-02a9-43c4-9b5b-cfd480f1eabd tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:30.413347 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-88256138-02a9-43c4-9b5b-cfd480f1eabd tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:30.413347 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-88256138-02a9-43c4-9b5b-cfd480f1eabd tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:30.414061 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-88256138-02a9-43c4-9b5b-cfd480f1eabd tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:30.414061 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-88256138-02a9-43c4-9b5b-cfd480f1eabd tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:30.414362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9635c4b1-074f-474b-be02-2562d0fd59e7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:30.416119 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9635c4b1-074f-474b-be02-2562d0fd59e7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:30.417605 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9635c4b1-074f-474b-be02-2562d0fd59e7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1331 microversion: 2.20 time: 0.151630 Aug 08 16:59:30.418389 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 478/961] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:30 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1331 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:30.449609 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-88256138-02a9-43c4-9b5b-cfd480f1eabd tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058274 Aug 08 16:59:30.449609 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 484/962] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:59:30 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 16:59:30.461028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-30cba8bf-75b2-4da8-93af-b257fdf59f2d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:30.461595 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-30cba8bf-75b2-4da8-93af-b257fdf59f2d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:30.468751 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-30cba8bf-75b2-4da8-93af-b257fdf59f2d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:30.469241 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-30cba8bf-75b2-4da8-93af-b257fdf59f2d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:30.472876 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-30cba8bf-75b2-4da8-93af-b257fdf59f2d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:30.472876 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-30cba8bf-75b2-4da8-93af-b257fdf59f2d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:30.472876 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-30cba8bf-75b2-4da8-93af-b257fdf59f2d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:30.472876 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-30cba8bf-75b2-4da8-93af-b257fdf59f2d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:30.560733 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-30cba8bf-75b2-4da8-93af-b257fdf59f2d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] HTTP exception thrown: Instance 173f1a4f-1673-4644-8730-67eaf9df2b61 is not attached to volume 917bd779-92cd-49b4-9b7e-053f9b3627a4 Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-30cba8bf-75b2-4da8-93af-b257fdf59f2d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Request method failure captured: Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: DELETE /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments/917bd779-92cd-49b4-9b7e-053f9b3627a4 HTTP/1.1 Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T_mYRBv1UscDElxd9F004Nu-4b_7xANqoroiqWW5ZIsfIZTvdP2rwUCZcie2lZk102MLHRf5DpLPTc5cDjrY55YC9LNDQGOQnP3hJ7l6CY3ONQhqvHKpDODx53bJ1LY_8McBxUX8Jr2JA2wRPziwoNtcYCL6JDl_LFMglbSSNAJVdY Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 236c710547184e33b1b14a88402fb363 Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-TestMinimumBasicScenario-398086934 Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:59:30.563216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:59:30.567940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_236c710547184e33b1b14a88402fb363", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/236c710547184e33b1b14a88402fb363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/236c710547184e33b1b14a88402fb363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/236c710547184e33b1b14a88402fb363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:59:30.567940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-TestMinimumBasicScenario-398086934 Aug 08 16:59:30.567940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 236c710547184e33b1b14a88402fb363 Aug 08 16:59:30.567940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-TestMinimumBasicScenario-398086934 Aug 08 16:59:30.567940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-TestMinimumBasicScenario-398086934-project Aug 08 16:59:30.567940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:59:30.567940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:59:30.567940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: fd667c5354f5499686dfe858bd159aa0 Aug 08 16:59:30.567940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-TestMinimumBasicScenario-398086934-project Aug 08 16:59:30.567940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:59:30.567940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 173f1a4f-1673-4644-8730-67eaf9df2b61 is not attached to volume 917bd779-92cd-49b4-9b7e-053f9b3627a4 Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'server_id': '173f1a4f-1673-4644-8730-67eaf9df2b61', 'id': '917bd779-92cd-49b4-9b7e-053f9b3627a4'} Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 917bd779-92cd-49b4-9b7e-053f9b3627a4. Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:59:30.569488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 173f1a4f-1673-4644-8730-67eaf9df2b61 is not attached to volume 917bd779-92cd-49b4-9b7e-053f9b3627a4 Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 173f1a4f-1673-4644-8730-67eaf9df2b61 is not attached to volume 917bd779-92cd-49b4-9b7e-053f9b3627a4 Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:30.576964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-30cba8bf-75b2-4da8-93af-b257fdf59f2d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Returning 404 to user: Instance 173f1a4f-1673-4644-8730-67eaf9df2b61 is not attached to volume 917bd779-92cd-49b4-9b7e-053f9b3627a4 {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:59:30.578331 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-30cba8bf-75b2-4da8-93af-b257fdf59f2d tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "DELETE /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments/917bd779-92cd-49b4-9b7e-053f9b3627a4" status: 404 len: 154 microversion: 2.1 time: 0.109537 Aug 08 16:59:30.578331 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 479/963] 10.222.0.13 () {58 vars in 1416 bytes} [Mon Aug 8 16:59:30 2022] DELETE /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61/os-volume_attachments/917bd779-92cd-49b4-9b7e-053f9b3627a4 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 16:59:30.727410 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:30.728099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:30.734419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:30.734946 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:30.735378 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:30.736093 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:30.736574 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:30.737519 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:30.773072 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:30.773557 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:30.773995 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:30.774468 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lazy-loading 'fault' on Instance uuid 65990fbf-4d36-42ed-8f3b-3406d373841a {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:59:30.829419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75d793a42ec74232899b7a19e36b5867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cac5ca5a8b04bce9a9d8ac938cd35e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:30.840086 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-af43bbfb-6edc-4e70-a36d-0ac43ad6f6cb tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 200 len: 1312 microversion: 2.1 time: 0.116659 Aug 08 16:59:30.841185 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 485/964] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:30 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 1312 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:31.216713 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-84b87139-1580-4b2c-8bc3-9a2de5361e06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:31.223113 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-84b87139-1580-4b2c-8bc3-9a2de5361e06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:31.238249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-84b87139-1580-4b2c-8bc3-9a2de5361e06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:31.239757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-84b87139-1580-4b2c-8bc3-9a2de5361e06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:31.240568 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-84b87139-1580-4b2c-8bc3-9a2de5361e06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:31.242023 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-84b87139-1580-4b2c-8bc3-9a2de5361e06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:31.242939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-84b87139-1580-4b2c-8bc3-9a2de5361e06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:31.243738 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-84b87139-1580-4b2c-8bc3-9a2de5361e06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:31.282471 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-84b87139-1580-4b2c-8bc3-9a2de5361e06 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072273 Aug 08 16:59:31.283573 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 480/965] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:59:31 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:31.458912 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c0f30bb8-fb50-4500-ad67-345931aebc0f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:31.459876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c0f30bb8-fb50-4500-ad67-345931aebc0f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:31.469658 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c0f30bb8-fb50-4500-ad67-345931aebc0f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:31.470531 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c0f30bb8-fb50-4500-ad67-345931aebc0f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:31.471468 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c0f30bb8-fb50-4500-ad67-345931aebc0f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:31.472802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c0f30bb8-fb50-4500-ad67-345931aebc0f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:31.473675 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c0f30bb8-fb50-4500-ad67-345931aebc0f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:31.474408 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c0f30bb8-fb50-4500-ad67-345931aebc0f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:31.572728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c0f30bb8-fb50-4500-ad67-345931aebc0f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:31.586599 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c0f30bb8-fb50-4500-ad67-345931aebc0f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:31.589916 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c0f30bb8-fb50-4500-ad67-345931aebc0f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:31.592346 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c0f30bb8-fb50-4500-ad67-345931aebc0f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1339 microversion: 2.20 time: 0.138651 Aug 08 16:59:31.593377 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 486/966] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:31 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1339 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:31.871398 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4ca571b5-182c-4531-b3bd-d954d66c5146 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:31.873485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4ca571b5-182c-4531-b3bd-d954d66c5146 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] [instance: 65990fbf-4d36-42ed-8f3b-3406d373841a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:31.892443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4ca571b5-182c-4531-b3bd-d954d66c5146 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:31.892443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4ca571b5-182c-4531-b3bd-d954d66c5146 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:31.892443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4ca571b5-182c-4531-b3bd-d954d66c5146 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:31.892443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4ca571b5-182c-4531-b3bd-d954d66c5146 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:31.892873 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4ca571b5-182c-4531-b3bd-d954d66c5146 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:31.892873 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4ca571b5-182c-4531-b3bd-d954d66c5146 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:31.909126 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-4ca571b5-182c-4531-b3bd-d954d66c5146 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] HTTP exception thrown: Instance 65990fbf-4d36-42ed-8f3b-3406d373841a could not be found. Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4ca571b5-182c-4531-b3bd-d954d66c5146 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Request method failure captured: Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a HTTP/1.1 Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8w-K7laAEb2eqcpAcIQgFUL6kuL4XLbKHs4o9M-2KdcOOU83uXV2cxJjak-BJlSZljXiBu3GBNqSP4Yv2wtKGu8Kt7fn3jcSbSzg6UkIEqkYSp3Fw6_bcPoQdHG8VL8tlrNTQRdwt7oFp1kxR960UJj4ylfDEF571Gojp3_bb3VaQ Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 6cac5ca5a8b04bce9a9d8ac938cd35e8 Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:59:31.911338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:59:31.912841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6cac5ca5a8b04bce9a9d8ac938cd35e8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6cac5ca5a8b04bce9a9d8ac938cd35e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:59:31.912841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:59:31.912841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 6cac5ca5a8b04bce9a9d8ac938cd35e8 Aug 08 16:59:31.912841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491888347 Aug 08 16:59:31.912841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-ServerRescueNegativeTestJSON-1491888347-project Aug 08 16:59:31.912841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:59:31.912841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:59:31.912841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: 75d793a42ec74232899b7a19e36b5867 Aug 08 16:59:31.912841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491888347-project Aug 08 16:59:31.912841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:59:31.912841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 65990fbf-4d36-42ed-8f3b-3406d373841a could not be found. Aug 08 16:59:31.912841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '65990fbf-4d36-42ed-8f3b-3406d373841a'} Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65990fbf-4d36-42ed-8f3b-3406d373841a could not be found. Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:59:31.913597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65990fbf-4d36-42ed-8f3b-3406d373841a could not be found. Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65990fbf-4d36-42ed-8f3b-3406d373841a could not be found. Aug 08 16:59:31.914863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:31.916620 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-26f2f79a-caa8-4401-9687-f06e1f83d6e6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:31.917128 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-26f2f79a-caa8-4401-9687-f06e1f83d6e6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:31.918015 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4ca571b5-182c-4531-b3bd-d954d66c5146 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] Returning 404 to user: Instance 65990fbf-4d36-42ed-8f3b-3406d373841a could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:59:31.919598 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4ca571b5-182c-4531-b3bd-d954d66c5146 tempest-ServerRescueNegativeTestJSON-1491888347 tempest-ServerRescueNegativeTestJSON-1491888347-project] 10.222.0.13 "GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a" status: 404 len: 111 microversion: 2.1 time: 0.056953 Aug 08 16:59:31.920356 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 481/967] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:31 2022] GET /compute/v2.1/servers/65990fbf-4d36-42ed-8f3b-3406d373841a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:59:31.924008 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-26f2f79a-caa8-4401-9687-f06e1f83d6e6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:31.924478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-26f2f79a-caa8-4401-9687-f06e1f83d6e6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:31.925785 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-26f2f79a-caa8-4401-9687-f06e1f83d6e6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:31.932619 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-26f2f79a-caa8-4401-9687-f06e1f83d6e6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:31.932619 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-26f2f79a-caa8-4401-9687-f06e1f83d6e6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:31.932619 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-26f2f79a-caa8-4401-9687-f06e1f83d6e6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:31.957841 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-26f2f79a-caa8-4401-9687-f06e1f83d6e6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:59:31.982697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:32.303980 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ecb88f5a-3235-4e31-a680-295b2c300f00 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:32.308884 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ecb88f5a-3235-4e31-a680-295b2c300f00 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:32.331572 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ecb88f5a-3235-4e31-a680-295b2c300f00 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:32.332854 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ecb88f5a-3235-4e31-a680-295b2c300f00 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:32.334829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ecb88f5a-3235-4e31-a680-295b2c300f00 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:32.340627 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ecb88f5a-3235-4e31-a680-295b2c300f00 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:32.341245 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ecb88f5a-3235-4e31-a680-295b2c300f00 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:32.341832 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ecb88f5a-3235-4e31-a680-295b2c300f00 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:32.385949 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ecb88f5a-3235-4e31-a680-295b2c300f00 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092387 Aug 08 16:59:32.390774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 482/968] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 16:59:32 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 16:59:32.397466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-26f2f79a-caa8-4401-9687-f06e1f83d6e6 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "DELETE /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 204 len: 0 microversion: 2.1 time: 0.484467 Aug 08 16:59:32.398441 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 487/969] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:59:31 2022] DELETE /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 16:59:32.407740 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-751a1929-0b3e-4089-a85f-2de040c422ff tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:32.408297 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-751a1929-0b3e-4089-a85f-2de040c422ff tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:32.417450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-751a1929-0b3e-4089-a85f-2de040c422ff tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:32.417960 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-751a1929-0b3e-4089-a85f-2de040c422ff tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:32.420785 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-751a1929-0b3e-4089-a85f-2de040c422ff tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:32.421604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-751a1929-0b3e-4089-a85f-2de040c422ff tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:32.422094 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-751a1929-0b3e-4089-a85f-2de040c422ff tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:32.422539 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-751a1929-0b3e-4089-a85f-2de040c422ff tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:32.509616 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-989f5d5b-f3c3-41c3-9f62-6526821dee2e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:32.510542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-989f5d5b-f3c3-41c3-9f62-6526821dee2e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:32.521767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-989f5d5b-f3c3-41c3-9f62-6526821dee2e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:32.523226 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-989f5d5b-f3c3-41c3-9f62-6526821dee2e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:32.524157 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-989f5d5b-f3c3-41c3-9f62-6526821dee2e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:32.525590 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-989f5d5b-f3c3-41c3-9f62-6526821dee2e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:32.526594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-989f5d5b-f3c3-41c3-9f62-6526821dee2e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:32.527660 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-989f5d5b-f3c3-41c3-9f62-6526821dee2e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:32.576324 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-989f5d5b-f3c3-41c3-9f62-6526821dee2e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 16:59:32.828932 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-751a1929-0b3e-4089-a85f-2de040c422ff tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:32.843337 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-751a1929-0b3e-4089-a85f-2de040c422ff tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1553 microversion: 2.1 time: 0.439631 Aug 08 16:59:32.844750 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 483/970] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:32 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1553 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:32.854442 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0f38b618-534f-4925-b091-df7e8d5033ae tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:32.855398 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0f38b618-534f-4925-b091-df7e8d5033ae tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:32.864088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f38b618-534f-4925-b091-df7e8d5033ae tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:32.864684 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f38b618-534f-4925-b091-df7e8d5033ae tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:32.865424 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f38b618-534f-4925-b091-df7e8d5033ae tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:32.866476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f38b618-534f-4925-b091-df7e8d5033ae tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:32.867197 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f38b618-534f-4925-b091-df7e8d5033ae tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:32.867686 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0f38b618-534f-4925-b091-df7e8d5033ae tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:32.940603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-989f5d5b-f3c3-41c3-9f62-6526821dee2e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 204 len: 0 microversion: 2.1 time: 0.436026 Aug 08 16:59:32.945163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 488/971] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 16:59:32 2022] DELETE /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 16:59:32.950998 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c7633247-12a2-4d82-97ac-beff0167b0c7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:32.952051 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c7633247-12a2-4d82-97ac-beff0167b0c7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:32.959231 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0f38b618-534f-4925-b091-df7e8d5033ae tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:32.963007 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c7633247-12a2-4d82-97ac-beff0167b0c7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:32.964228 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c7633247-12a2-4d82-97ac-beff0167b0c7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:32.965285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c7633247-12a2-4d82-97ac-beff0167b0c7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:32.966878 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c7633247-12a2-4d82-97ac-beff0167b0c7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:32.967678 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c7633247-12a2-4d82-97ac-beff0167b0c7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:32.968417 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c7633247-12a2-4d82-97ac-beff0167b0c7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:32.968558 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0f38b618-534f-4925-b091-df7e8d5033ae tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:32.970658 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0f38b618-534f-4925-b091-df7e8d5033ae tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:32.972463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0f38b618-534f-4925-b091-df7e8d5033ae tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1337 microversion: 2.20 time: 0.125787 Aug 08 16:59:32.973769 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 484/972] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:32 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1337 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:33.342872 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c7633247-12a2-4d82-97ac-beff0167b0c7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:33.352113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c7633247-12a2-4d82-97ac-beff0167b0c7 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1681 microversion: 2.1 time: 0.405392 Aug 08 16:59:33.352902 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 489/973] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:32 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1681 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:33.877142 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4780ca02-191a-47a0-a66b-cf5083d65515 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:33.878917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4780ca02-191a-47a0-a66b-cf5083d65515 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:33.893682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4780ca02-191a-47a0-a66b-cf5083d65515 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:33.894511 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4780ca02-191a-47a0-a66b-cf5083d65515 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:33.895083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4780ca02-191a-47a0-a66b-cf5083d65515 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:33.896839 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4780ca02-191a-47a0-a66b-cf5083d65515 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:33.897560 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4780ca02-191a-47a0-a66b-cf5083d65515 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:33.898003 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4780ca02-191a-47a0-a66b-cf5083d65515 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:33.999125 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6dcbb322-56c4-4ab0-a883-274e63fe36df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:34.000157 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6dcbb322-56c4-4ab0-a883-274e63fe36df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:34.013078 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6dcbb322-56c4-4ab0-a883-274e63fe36df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:34.014150 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6dcbb322-56c4-4ab0-a883-274e63fe36df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:34.015520 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6dcbb322-56c4-4ab0-a883-274e63fe36df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:34.018900 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6dcbb322-56c4-4ab0-a883-274e63fe36df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:34.019945 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6dcbb322-56c4-4ab0-a883-274e63fe36df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:34.021264 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6dcbb322-56c4-4ab0-a883-274e63fe36df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:34.060091 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4780ca02-191a-47a0-a66b-cf5083d65515 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:34.077260 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4780ca02-191a-47a0-a66b-cf5083d65515 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1553 microversion: 2.1 time: 0.206097 Aug 08 16:59:34.078642 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 485/974] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:33 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:34.238502 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6dcbb322-56c4-4ab0-a883-274e63fe36df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:34.251327 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6dcbb322-56c4-4ab0-a883-274e63fe36df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:34.254337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6dcbb322-56c4-4ab0-a883-274e63fe36df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:34.256082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6dcbb322-56c4-4ab0-a883-274e63fe36df tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1405 microversion: 2.20 time: 0.262846 Aug 08 16:59:34.257401 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 490/975] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:33 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:34.376729 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f7218d8e-1eef-4028-a49e-308b3e970a5c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:34.378553 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f7218d8e-1eef-4028-a49e-308b3e970a5c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:34.388379 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7218d8e-1eef-4028-a49e-308b3e970a5c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:34.389128 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7218d8e-1eef-4028-a49e-308b3e970a5c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:34.389880 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7218d8e-1eef-4028-a49e-308b3e970a5c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:34.391075 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7218d8e-1eef-4028-a49e-308b3e970a5c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:34.391938 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7218d8e-1eef-4028-a49e-308b3e970a5c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:34.392749 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f7218d8e-1eef-4028-a49e-308b3e970a5c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:34.707076 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f7218d8e-1eef-4028-a49e-308b3e970a5c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:34.720263 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f7218d8e-1eef-4028-a49e-308b3e970a5c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1681 microversion: 2.1 time: 0.347852 Aug 08 16:59:34.722400 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 486/976] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:34 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1681 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:35.108134 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f9e9ba3f-4584-4d2e-ac45-ea016f4e8312 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:35.109270 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f9e9ba3f-4584-4d2e-ac45-ea016f4e8312 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:35.123103 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f9e9ba3f-4584-4d2e-ac45-ea016f4e8312 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:35.124222 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f9e9ba3f-4584-4d2e-ac45-ea016f4e8312 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:35.124933 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f9e9ba3f-4584-4d2e-ac45-ea016f4e8312 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:35.126187 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f9e9ba3f-4584-4d2e-ac45-ea016f4e8312 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:35.128188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f9e9ba3f-4584-4d2e-ac45-ea016f4e8312 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:35.129282 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f9e9ba3f-4584-4d2e-ac45-ea016f4e8312 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:35.280996 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ab572ea5-eed1-43d4-9696-13efa609783a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:35.281707 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ab572ea5-eed1-43d4-9696-13efa609783a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:35.291617 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab572ea5-eed1-43d4-9696-13efa609783a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:35.292503 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab572ea5-eed1-43d4-9696-13efa609783a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:35.293018 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab572ea5-eed1-43d4-9696-13efa609783a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:35.294546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab572ea5-eed1-43d4-9696-13efa609783a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:35.295118 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab572ea5-eed1-43d4-9696-13efa609783a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:35.295669 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ab572ea5-eed1-43d4-9696-13efa609783a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:35.372342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f9e9ba3f-4584-4d2e-ac45-ea016f4e8312 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:35.386341 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f9e9ba3f-4584-4d2e-ac45-ea016f4e8312 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1553 microversion: 2.1 time: 0.288300 Aug 08 16:59:35.387107 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 491/977] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:35 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1553 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:35.651484 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ab572ea5-eed1-43d4-9696-13efa609783a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:35.669300 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ab572ea5-eed1-43d4-9696-13efa609783a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:35.673001 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ab572ea5-eed1-43d4-9696-13efa609783a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:35.679319 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ab572ea5-eed1-43d4-9696-13efa609783a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1405 microversion: 2.20 time: 0.398094 Aug 08 16:59:35.679319 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 487/978] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:35 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:59:35.763858 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1ac09f1a-267d-4a0b-942f-d6d4ca36397b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:35.764505 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1ac09f1a-267d-4a0b-942f-d6d4ca36397b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:35.771912 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1ac09f1a-267d-4a0b-942f-d6d4ca36397b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:35.772418 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1ac09f1a-267d-4a0b-942f-d6d4ca36397b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:35.772943 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1ac09f1a-267d-4a0b-942f-d6d4ca36397b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:35.773743 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1ac09f1a-267d-4a0b-942f-d6d4ca36397b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:35.774235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1ac09f1a-267d-4a0b-942f-d6d4ca36397b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:35.774761 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1ac09f1a-267d-4a0b-942f-d6d4ca36397b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:35.945575 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-b516edce-d606-479b-97fd-a8858da743b4 req-5f2d392f-eb41-4ae8-acfc-94b492fde7cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37eeb765-0b75-4da4-be22-9fc72927ff6a", "tag": "25f9ae20-5161-4130-bc9b-d7c23e20ddc0"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:35.949395 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1ac09f1a-267d-4a0b-942f-d6d4ca36397b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:35.955861 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b516edce-d606-479b-97fd-a8858da743b4 req-5f2d392f-eb41-4ae8-acfc-94b492fde7cf service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:35.956368 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b516edce-d606-479b-97fd-a8858da743b4 req-5f2d392f-eb41-4ae8-acfc-94b492fde7cf service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:35.957327 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b516edce-d606-479b-97fd-a8858da743b4 req-5f2d392f-eb41-4ae8-acfc-94b492fde7cf service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:35.964433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1ac09f1a-267d-4a0b-942f-d6d4ca36397b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1681 microversion: 2.1 time: 0.204758 Aug 08 16:59:35.965506 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 492/979] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:35 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:35.982770 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-b516edce-d606-479b-97fd-a8858da743b4 req-5f2d392f-eb41-4ae8-acfc-94b492fde7cf service nova] Creating event network-changed:25f9ae20-5161-4130-bc9b-d7c23e20ddc0 for instance 37eeb765-0b75-4da4-be22-9fc72927ff6a on hv-cinder-85220 Aug 08 16:59:35.989937 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-b516edce-d606-479b-97fd-a8858da743b4 req-5f2d392f-eb41-4ae8-acfc-94b492fde7cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047968 Aug 08 16:59:35.990604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 488/980] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:36.423057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6226f036-2e59-4040-a1b4-0d36895b5547 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:36.424313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6226f036-2e59-4040-a1b4-0d36895b5547 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:36.435709 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6226f036-2e59-4040-a1b4-0d36895b5547 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:36.436606 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6226f036-2e59-4040-a1b4-0d36895b5547 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:36.437582 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6226f036-2e59-4040-a1b4-0d36895b5547 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:36.439174 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6226f036-2e59-4040-a1b4-0d36895b5547 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:36.440492 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6226f036-2e59-4040-a1b4-0d36895b5547 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:36.441230 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6226f036-2e59-4040-a1b4-0d36895b5547 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:36.724398 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-952a4b8a-d114-4622-92b9-0cee7b62b32e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:36.725720 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-952a4b8a-d114-4622-92b9-0cee7b62b32e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:36.736242 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-952a4b8a-d114-4622-92b9-0cee7b62b32e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:36.737258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-952a4b8a-d114-4622-92b9-0cee7b62b32e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:36.737710 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-952a4b8a-d114-4622-92b9-0cee7b62b32e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:36.738990 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-952a4b8a-d114-4622-92b9-0cee7b62b32e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:36.739443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-952a4b8a-d114-4622-92b9-0cee7b62b32e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:36.739877 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-952a4b8a-d114-4622-92b9-0cee7b62b32e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:37.109729 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6226f036-2e59-4040-a1b4-0d36895b5547 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:37.119158 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6226f036-2e59-4040-a1b4-0d36895b5547 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1553 microversion: 2.1 time: 0.701981 Aug 08 16:59:37.134133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 493/981] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:36 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1553 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:59:37.139511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-47365fec-c3cf-4a38-8b8f-a525244df8ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:37.140249 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-47365fec-c3cf-4a38-8b8f-a525244df8ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:37.147500 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-47365fec-c3cf-4a38-8b8f-a525244df8ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:37.148392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-47365fec-c3cf-4a38-8b8f-a525244df8ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:37.149142 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-47365fec-c3cf-4a38-8b8f-a525244df8ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:37.150175 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-47365fec-c3cf-4a38-8b8f-a525244df8ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:37.150767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-47365fec-c3cf-4a38-8b8f-a525244df8ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:37.151276 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-47365fec-c3cf-4a38-8b8f-a525244df8ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:37.381580 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-952a4b8a-d114-4622-92b9-0cee7b62b32e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:37.401066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-952a4b8a-d114-4622-92b9-0cee7b62b32e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:37.404906 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-952a4b8a-d114-4622-92b9-0cee7b62b32e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:37.418891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-952a4b8a-d114-4622-92b9-0cee7b62b32e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1405 microversion: 2.20 time: 0.691990 Aug 08 16:59:37.418891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 489/982] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:36 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1405 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:37.540772 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-47365fec-c3cf-4a38-8b8f-a525244df8ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:37.550490 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-47365fec-c3cf-4a38-8b8f-a525244df8ed tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1681 microversion: 2.1 time: 0.414989 Aug 08 16:59:37.551754 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 494/983] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:37 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1681 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:38.148083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-830448d5-6843-413c-8a09-e4f9b37f15bf tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:38.149085 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-830448d5-6843-413c-8a09-e4f9b37f15bf tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:38.163296 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-830448d5-6843-413c-8a09-e4f9b37f15bf tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:38.164904 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-830448d5-6843-413c-8a09-e4f9b37f15bf tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:38.166166 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-830448d5-6843-413c-8a09-e4f9b37f15bf tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:38.167935 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-830448d5-6843-413c-8a09-e4f9b37f15bf tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:38.169249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-830448d5-6843-413c-8a09-e4f9b37f15bf tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:38.171952 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-830448d5-6843-413c-8a09-e4f9b37f15bf tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:38.454361 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-54d73859-ef8d-4c49-a487-8c7d5f0cda8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:38.456360 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-54d73859-ef8d-4c49-a487-8c7d5f0cda8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:38.458997 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:38.460146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=6 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:38.469864 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-54d73859-ef8d-4c49-a487-8c7d5f0cda8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:38.470690 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-54d73859-ef8d-4c49-a487-8c7d5f0cda8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:38.480235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-54d73859-ef8d-4c49-a487-8c7d5f0cda8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:38.480235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-54d73859-ef8d-4c49-a487-8c7d5f0cda8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:38.480235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-54d73859-ef8d-4c49-a487-8c7d5f0cda8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:38.480235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-54d73859-ef8d-4c49-a487-8c7d5f0cda8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:38.670921 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-54d73859-ef8d-4c49-a487-8c7d5f0cda8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:38.683310 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-54d73859-ef8d-4c49-a487-8c7d5f0cda8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:38.686204 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-54d73859-ef8d-4c49-a487-8c7d5f0cda8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:38.687774 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-54d73859-ef8d-4c49-a487-8c7d5f0cda8d tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1405 microversion: 2.20 time: 0.238962 Aug 08 16:59:38.688572 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 495/984] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:38 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:38.696940 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5f3e153f-3abf-4620-881b-0502e539f8ba tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:38.697754 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5f3e153f-3abf-4620-881b-0502e539f8ba tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:38.704673 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5f3e153f-3abf-4620-881b-0502e539f8ba tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:38.706616 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5f3e153f-3abf-4620-881b-0502e539f8ba tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:38.707392 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5f3e153f-3abf-4620-881b-0502e539f8ba tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:38.708321 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5f3e153f-3abf-4620-881b-0502e539f8ba tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:38.709036 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5f3e153f-3abf-4620-881b-0502e539f8ba tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:38.709702 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5f3e153f-3abf-4620-881b-0502e539f8ba tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:38.840460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-830448d5-6843-413c-8a09-e4f9b37f15bf tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:38.867512 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-830448d5-6843-413c-8a09-e4f9b37f15bf tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1553 microversion: 2.1 time: 0.727909 Aug 08 16:59:38.870459 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 490/985] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:38 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1553 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:38.926270 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-5f3e153f-3abf-4620-881b-0502e539f8ba tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:38.934924 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5f3e153f-3abf-4620-881b-0502e539f8ba tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1681 microversion: 2.1 time: 0.243816 Aug 08 16:59:38.950114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 496/986] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:38 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:39.042611 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-1c8079bf-bde1-4239-b3cd-3b11e2c5f66f req-ffa37cf8-790c-4de8-840e-92fd6b1b371f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d228b747-dc71-4145-bc09-820362dc7fc3", "name": "network-vif-unplugged", "status": "completed", "tag": "0679f117-d099-44e2-88f2-6601e3adbc88"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:39.060220 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-1c8079bf-bde1-4239-b3cd-3b11e2c5f66f req-ffa37cf8-790c-4de8-840e-92fd6b1b371f service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:39.061827 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-1c8079bf-bde1-4239-b3cd-3b11e2c5f66f req-ffa37cf8-790c-4de8-840e-92fd6b1b371f service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:39.063025 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-1c8079bf-bde1-4239-b3cd-3b11e2c5f66f req-ffa37cf8-790c-4de8-840e-92fd6b1b371f service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:39.083361 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-1c8079bf-bde1-4239-b3cd-3b11e2c5f66f req-ffa37cf8-790c-4de8-840e-92fd6b1b371f service nova] Creating event network-vif-unplugged:0679f117-d099-44e2-88f2-6601e3adbc88 for instance d228b747-dc71-4145-bc09-820362dc7fc3 on hv-cinder-85220 Aug 08 16:59:39.093182 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-1c8079bf-bde1-4239-b3cd-3b11e2c5f66f req-ffa37cf8-790c-4de8-840e-92fd6b1b371f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055030 Aug 08 16:59:39.094417 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 491/987] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:39.164974 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-98273d00-e28e-45e0-a57a-246ee1460dda req-af3fe726-6f02-44f9-a32f-a1b15dea7d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "173f1a4f-1673-4644-8730-67eaf9df2b61", "name": "network-vif-deleted", "tag": "e664734d-6d99-473f-9417-434a305e356c"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:39.182103 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-98273d00-e28e-45e0-a57a-246ee1460dda req-af3fe726-6f02-44f9-a32f-a1b15dea7d5c service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:39.182878 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-98273d00-e28e-45e0-a57a-246ee1460dda req-af3fe726-6f02-44f9-a32f-a1b15dea7d5c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:39.183726 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-98273d00-e28e-45e0-a57a-246ee1460dda req-af3fe726-6f02-44f9-a32f-a1b15dea7d5c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:39.209811 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-98273d00-e28e-45e0-a57a-246ee1460dda req-af3fe726-6f02-44f9-a32f-a1b15dea7d5c service nova] Creating event network-vif-deleted:e664734d-6d99-473f-9417-434a305e356c for instance 173f1a4f-1673-4644-8730-67eaf9df2b61 on hv-cinder-85220 Aug 08 16:59:39.225052 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-98273d00-e28e-45e0-a57a-246ee1460dda req-af3fe726-6f02-44f9-a32f-a1b15dea7d5c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062629 Aug 08 16:59:39.225052 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 497/988] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:39.733701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4e89fddb-bcd5-4d4a-aebb-f23e4ddd731b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:39.738301 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4e89fddb-bcd5-4d4a-aebb-f23e4ddd731b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:39.742814 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=8 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:39.754253 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4e89fddb-bcd5-4d4a-aebb-f23e4ddd731b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:39.755217 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4e89fddb-bcd5-4d4a-aebb-f23e4ddd731b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:39.756031 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4e89fddb-bcd5-4d4a-aebb-f23e4ddd731b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:39.757351 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4e89fddb-bcd5-4d4a-aebb-f23e4ddd731b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:39.758201 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4e89fddb-bcd5-4d4a-aebb-f23e4ddd731b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:39.758961 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4e89fddb-bcd5-4d4a-aebb-f23e4ddd731b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:39.899921 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:39.909805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:39.921701 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:39.922784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:39.923667 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:39.926127 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:39.947810 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:39.953204 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:40.035368 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:40.036356 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:40.037632 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:40.039331 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lazy-loading 'fault' on Instance uuid 173f1a4f-1673-4644-8730-67eaf9df2b61 {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:59:40.097918 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4e89fddb-bcd5-4d4a-aebb-f23e4ddd731b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:40.117375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4e89fddb-bcd5-4d4a-aebb-f23e4ddd731b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:40.122493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4e89fddb-bcd5-4d4a-aebb-f23e4ddd731b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:40.125551 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4e89fddb-bcd5-4d4a-aebb-f23e4ddd731b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1405 microversion: 2.20 time: 0.399153 Aug 08 16:59:40.128088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 492/989] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:39 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:40.164679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f67390d3-c831-4b4d-abc8-c0dad1e8f7bb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:40.166254 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f67390d3-c831-4b4d-abc8-c0dad1e8f7bb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:40.180376 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f67390d3-c831-4b4d-abc8-c0dad1e8f7bb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:40.181791 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f67390d3-c831-4b4d-abc8-c0dad1e8f7bb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:40.182859 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f67390d3-c831-4b4d-abc8-c0dad1e8f7bb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:40.184646 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f67390d3-c831-4b4d-abc8-c0dad1e8f7bb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:40.185772 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f67390d3-c831-4b4d-abc8-c0dad1e8f7bb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:40.187440 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f67390d3-c831-4b4d-abc8-c0dad1e8f7bb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:40.219597 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd667c5354f5499686dfe858bd159aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236c710547184e33b1b14a88402fb363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:40.257928 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c58f5311-dd4b-42a1-8ac9-23742c431136 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 200 len: 1348 microversion: 2.1 time: 0.365747 Aug 08 16:59:40.259524 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 498/990] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:39 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 1348 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:40.332725 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f67390d3-c831-4b4d-abc8-c0dad1e8f7bb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:40.341502 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f67390d3-c831-4b4d-abc8-c0dad1e8f7bb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1613 microversion: 2.1 time: 0.210028 Aug 08 16:59:40.342100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 493/991] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:40 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1613 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:41.169198 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-242b9639-df86-4a6e-a4cb-11ea0aa6ba64 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:41.170292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-242b9639-df86-4a6e-a4cb-11ea0aa6ba64 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:41.185053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-242b9639-df86-4a6e-a4cb-11ea0aa6ba64 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:41.185952 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-242b9639-df86-4a6e-a4cb-11ea0aa6ba64 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:41.186843 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-242b9639-df86-4a6e-a4cb-11ea0aa6ba64 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:41.188220 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-242b9639-df86-4a6e-a4cb-11ea0aa6ba64 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:41.189342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-242b9639-df86-4a6e-a4cb-11ea0aa6ba64 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:41.190855 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-242b9639-df86-4a6e-a4cb-11ea0aa6ba64 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:41.240978 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-4090d318-5901-4cee-bb0a-58b3b3031681 req-77550456-5b3c-4167-88d4-01d3ba0de296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d228b747-dc71-4145-bc09-820362dc7fc3", "name": "network-vif-deleted", "tag": "0679f117-d099-44e2-88f2-6601e3adbc88"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:41.251915 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-4090d318-5901-4cee-bb0a-58b3b3031681 req-77550456-5b3c-4167-88d4-01d3ba0de296 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:41.253246 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-4090d318-5901-4cee-bb0a-58b3b3031681 req-77550456-5b3c-4167-88d4-01d3ba0de296 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:41.253797 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-4090d318-5901-4cee-bb0a-58b3b3031681 req-77550456-5b3c-4167-88d4-01d3ba0de296 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:41.274158 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-4090d318-5901-4cee-bb0a-58b3b3031681 req-77550456-5b3c-4167-88d4-01d3ba0de296 service nova] Creating event network-vif-deleted:0679f117-d099-44e2-88f2-6601e3adbc88 for instance d228b747-dc71-4145-bc09-820362dc7fc3 on hv-cinder-85220 Aug 08 16:59:41.284738 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-4090d318-5901-4cee-bb0a-58b3b3031681 req-77550456-5b3c-4167-88d4-01d3ba0de296 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046871 Aug 08 16:59:41.285788 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 494/992] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:41.300569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9d26ebae-11fd-41c4-a8ce-c149d7fe5901 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:41.301635 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9d26ebae-11fd-41c4-a8ce-c149d7fe5901 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] [instance: 173f1a4f-1673-4644-8730-67eaf9df2b61] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:41.320348 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9d26ebae-11fd-41c4-a8ce-c149d7fe5901 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:41.320934 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9d26ebae-11fd-41c4-a8ce-c149d7fe5901 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:41.321392 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9d26ebae-11fd-41c4-a8ce-c149d7fe5901 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:41.322150 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9d26ebae-11fd-41c4-a8ce-c149d7fe5901 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:41.322639 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9d26ebae-11fd-41c4-a8ce-c149d7fe5901 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:41.323081 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9d26ebae-11fd-41c4-a8ce-c149d7fe5901 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:41.341665 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-9d26ebae-11fd-41c4-a8ce-c149d7fe5901 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] HTTP exception thrown: Instance 173f1a4f-1673-4644-8730-67eaf9df2b61 could not be found. Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9d26ebae-11fd-41c4-a8ce-c149d7fe5901 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Request method failure captured: Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 HTTP/1.1 Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T_mYRBv1UscDElxd9F004Nu-4b_7xANqoroiqWW5ZIsfIZTvdP2rwUCZcie2lZk102MLHRf5DpLPTc5cDjrY55YC9LNDQGOQnP3hJ7l6CY3ONQhqvHKpDODx53bJ1LY_8McBxUX8Jr2JA2wRPziwoNtcYCL6JDl_LFMglbSSNAJVdY Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 236c710547184e33b1b14a88402fb363 Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-TestMinimumBasicScenario-398086934 Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:59:41.343450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:59:41.344871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_236c710547184e33b1b14a88402fb363", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/236c710547184e33b1b14a88402fb363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/236c710547184e33b1b14a88402fb363"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/236c710547184e33b1b14a88402fb363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:59:41.344871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-TestMinimumBasicScenario-398086934 Aug 08 16:59:41.344871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 236c710547184e33b1b14a88402fb363 Aug 08 16:59:41.344871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-TestMinimumBasicScenario-398086934 Aug 08 16:59:41.344871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-TestMinimumBasicScenario-398086934-project Aug 08 16:59:41.344871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:59:41.344871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:59:41.344871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: fd667c5354f5499686dfe858bd159aa0 Aug 08 16:59:41.344871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-TestMinimumBasicScenario-398086934-project Aug 08 16:59:41.344871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:59:41.344871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 173f1a4f-1673-4644-8730-67eaf9df2b61 could not be found. Aug 08 16:59:41.344871 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '173f1a4f-1673-4644-8730-67eaf9df2b61'} Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 173f1a4f-1673-4644-8730-67eaf9df2b61 could not be found. Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:59:41.346378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 173f1a4f-1673-4644-8730-67eaf9df2b61 could not be found. Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 173f1a4f-1673-4644-8730-67eaf9df2b61 could not be found. Aug 08 16:59:41.348556 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:41.350276 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9d26ebae-11fd-41c4-a8ce-c149d7fe5901 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Returning 404 to user: Instance 173f1a4f-1673-4644-8730-67eaf9df2b61 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:59:41.350276 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9d26ebae-11fd-41c4-a8ce-c149d7fe5901 tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61" status: 404 len: 111 microversion: 2.1 time: 0.049214 Aug 08 16:59:41.352261 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 495/993] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:41 2022] GET /compute/v2.1/servers/173f1a4f-1673-4644-8730-67eaf9df2b61 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 16:59:41.357916 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9eee8c8f-15de-4d00-9005-9b435ff93ebe tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] Calling method '.version_select at 0x7f501621a3a0>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:41.453786 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-242b9639-df86-4a6e-a4cb-11ea0aa6ba64 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:41.457989 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9eee8c8f-15de-4d00-9005-9b435ff93ebe tempest-TestMinimumBasicScenario-398086934 tempest-TestMinimumBasicScenario-398086934-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1177739294" status: 202 len: 0 microversion: 2.1 time: 0.103413 Aug 08 16:59:41.466483 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 496/994] 10.222.0.13 () {58 vars in 1272 bytes} [Mon Aug 8 16:59:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1177739294 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:59:41.473611 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:41.475472 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:41.485407 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-242b9639-df86-4a6e-a4cb-11ea0aa6ba64 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:41.488560 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-242b9639-df86-4a6e-a4cb-11ea0aa6ba64 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:41.490343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-242b9639-df86-4a6e-a4cb-11ea0aa6ba64 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1405 microversion: 2.20 time: 0.330558 Aug 08 16:59:41.491728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 499/995] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:41 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1405 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:41.492780 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:41.493613 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:41.494512 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:41.496346 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:41.497196 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:41.497912 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:41.541480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:41.541971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:41.542420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:41.542924 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lazy-loading 'fault' on Instance uuid d228b747-dc71-4145-bc09-820362dc7fc3 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 16:59:41.596836 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:41.612926 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b84fdf5d-1ce5-470b-a3d5-671dee8ee497 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 200 len: 1331 microversion: 2.1 time: 0.151854 Aug 08 16:59:41.613877 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 497/996] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:41 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 1331 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:42.534313 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ea674c38-aa5f-4368-b6c8-08e30bbcf8d6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:42.535011 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ea674c38-aa5f-4368-b6c8-08e30bbcf8d6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:42.542851 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ea674c38-aa5f-4368-b6c8-08e30bbcf8d6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:42.543355 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ea674c38-aa5f-4368-b6c8-08e30bbcf8d6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:42.543802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ea674c38-aa5f-4368-b6c8-08e30bbcf8d6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:42.544560 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ea674c38-aa5f-4368-b6c8-08e30bbcf8d6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:42.546074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ea674c38-aa5f-4368-b6c8-08e30bbcf8d6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:42.546074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ea674c38-aa5f-4368-b6c8-08e30bbcf8d6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:42.636718 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-abe0c530-5520-40e6-a670-d29b8ead481f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:42.636718 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-abe0c530-5520-40e6-a670-d29b8ead481f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:42.645202 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-abe0c530-5520-40e6-a670-d29b8ead481f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:42.645810 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-abe0c530-5520-40e6-a670-d29b8ead481f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:42.646461 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-abe0c530-5520-40e6-a670-d29b8ead481f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:42.647354 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-abe0c530-5520-40e6-a670-d29b8ead481f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:42.648084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-abe0c530-5520-40e6-a670-d29b8ead481f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:42.648596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-abe0c530-5520-40e6-a670-d29b8ead481f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:42.664907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-abe0c530-5520-40e6-a670-d29b8ead481f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-abe0c530-5520-40e6-a670-d29b8ead481f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 HTTP/1.1 Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 16:59:42.666826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 16:59:42.668394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 16:59:42.668394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:59:42.668394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 16:59:42.668394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 16:59:42.668394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 16:59:42.668394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 16:59:42.668394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 16:59:42.668394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 16:59:42.668394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 16:59:42.668394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 16:59:42.668394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 16:59:42.668394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'd228b747-dc71-4145-bc09-820362dc7fc3'} Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 16:59:42.669199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 16:59:42.675819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 16:59:42.678494 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-abe0c530-5520-40e6-a670-d29b8ead481f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 404 to user: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 16:59:42.678494 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-abe0c530-5520-40e6-a670-d29b8ead481f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 404 len: 111 microversion: 2.1 time: 0.036559 Aug 08 16:59:42.678494 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 498/997] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:42 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 16:59:42.682955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8c1af30a-539f-4287-b0c3-69de515dbd67 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '.version_select at 0x7f501617a550>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:42.768714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8c1af30a-539f-4287-b0c3-69de515dbd67 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-838946971" status: 202 len: 0 microversion: 2.1 time: 0.091320 Aug 08 16:59:42.785308 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 499/998] 10.222.0.13 () {58 vars in 1218 bytes} [Mon Aug 8 16:59:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-838946971 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 16:59:42.785884 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ea674c38-aa5f-4368-b6c8-08e30bbcf8d6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:42.785884 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ea674c38-aa5f-4368-b6c8-08e30bbcf8d6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:42.786228 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ea674c38-aa5f-4368-b6c8-08e30bbcf8d6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:42.787266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ea674c38-aa5f-4368-b6c8-08e30bbcf8d6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1405 microversion: 2.20 time: 0.258052 Aug 08 16:59:42.788045 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 500/999] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:42 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:59:43.812906 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ace5a436-c3f9-4cde-ba42-d13fae91db41 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:43.814202 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ace5a436-c3f9-4cde-ba42-d13fae91db41 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:43.833488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ace5a436-c3f9-4cde-ba42-d13fae91db41 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:43.834231 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ace5a436-c3f9-4cde-ba42-d13fae91db41 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:43.835308 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ace5a436-c3f9-4cde-ba42-d13fae91db41 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:43.836462 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ace5a436-c3f9-4cde-ba42-d13fae91db41 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:43.837074 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ace5a436-c3f9-4cde-ba42-d13fae91db41 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:43.837657 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ace5a436-c3f9-4cde-ba42-d13fae91db41 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:43.844109 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-302f5700-b956-49f1-ada6-1daaca337db9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Action: 'create', calling method: .version_select at 0x7f50161f6280>, body: {"keypair": {"name": "tempest-keypair-1707161265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5CsVqjLlpknoi01mcjOI7wKARngLyw7jYdL/eu6TFZhGMreaohqnSkYpHNH+f8oy9plKo7CZTXgyy6W54YMtX/hGMngWpqxp+0AZUNX7BO2g7WDnJlcrwCW7Zs2bjsvw=="}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:43.878343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-302f5700-b956-49f1-ada6-1daaca337db9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for project b2063a114c1942cab80ae4b708be9ab2. Resources: {'key_pairs'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:59:43.885188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-302f5700-b956-49f1-ada6-1daaca337db9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for user fdb16e7edbe143e9b96325842896f04e and project b2063a114c1942cab80ae4b708be9ab2. Resources: {'key_pairs'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:59:44.022793 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-302f5700-b956-49f1-ada6-1daaca337db9 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185349 Aug 08 16:59:44.023824 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 501/1000] 10.222.0.13 () {60 vars in 1159 bytes} [Mon Aug 8 16:59:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:44.067027 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ace5a436-c3f9-4cde-ba42-d13fae91db41 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:44.076595 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ace5a436-c3f9-4cde-ba42-d13fae91db41 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:44.078311 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ace5a436-c3f9-4cde-ba42-d13fae91db41 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:44.079599 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ace5a436-c3f9-4cde-ba42-d13fae91db41 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1405 microversion: 2.20 time: 0.273448 Aug 08 16:59:44.080867 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 500/1001] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:43 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:59:44.406742 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4b152202-eaad-4bd8-94c2-f8b0f60685c1 tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] Calling method '.version_select at 0x7f501a9ccdc0>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:44.482943 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4b152202-eaad-4bd8-94c2-f8b0f60685c1 tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/55a8aa93-2537-451a-8078-81f7e84238b9" status: 200 len: 350 microversion: 2.1 time: 0.079572 Aug 08 16:59:44.484180 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 502/1002] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:59:44 2022] GET /compute/v2.1/os-volumes/55a8aa93-2537-451a-8078-81f7e84238b9 => generated 350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:44.815311 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-9cbeb2fe-8198-463a-b1a7-a7e47841ff2f req-f994d1c2-a752-46ab-8721-cd8e400a2d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37eeb765-0b75-4da4-be22-9fc72927ff6a", "name": "network-vif-plugged", "status": "completed", "tag": "25f9ae20-5161-4130-bc9b-d7c23e20ddc0"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:44.831076 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-9cbeb2fe-8198-463a-b1a7-a7e47841ff2f req-f994d1c2-a752-46ab-8721-cd8e400a2d04 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:44.841847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-9cbeb2fe-8198-463a-b1a7-a7e47841ff2f req-f994d1c2-a752-46ab-8721-cd8e400a2d04 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:44.841847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-9cbeb2fe-8198-463a-b1a7-a7e47841ff2f req-f994d1c2-a752-46ab-8721-cd8e400a2d04 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:44.841847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=100 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:44.848153 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-9cbeb2fe-8198-463a-b1a7-a7e47841ff2f req-f994d1c2-a752-46ab-8721-cd8e400a2d04 service nova] Creating event network-vif-plugged:25f9ae20-5161-4130-bc9b-d7c23e20ddc0 for instance 37eeb765-0b75-4da4-be22-9fc72927ff6a on hv-cinder-85220 Aug 08 16:59:44.853483 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-9cbeb2fe-8198-463a-b1a7-a7e47841ff2f req-f994d1c2-a752-46ab-8721-cd8e400a2d04 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042454 Aug 08 16:59:44.854113 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 501/1003] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:45.108737 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f08b0127-6c01-4bbf-92c8-562a03ff361b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:45.109448 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f08b0127-6c01-4bbf-92c8-562a03ff361b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:45.117903 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f08b0127-6c01-4bbf-92c8-562a03ff361b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:45.118843 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f08b0127-6c01-4bbf-92c8-562a03ff361b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:45.119481 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f08b0127-6c01-4bbf-92c8-562a03ff361b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:45.120389 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f08b0127-6c01-4bbf-92c8-562a03ff361b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:45.121183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f08b0127-6c01-4bbf-92c8-562a03ff361b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:45.121784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f08b0127-6c01-4bbf-92c8-562a03ff361b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:45.412633 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f08b0127-6c01-4bbf-92c8-562a03ff361b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:45.426585 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f08b0127-6c01-4bbf-92c8-562a03ff361b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:45.430029 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f08b0127-6c01-4bbf-92c8-562a03ff361b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:45.433165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f08b0127-6c01-4bbf-92c8-562a03ff361b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1405 microversion: 2.20 time: 0.329457 Aug 08 16:59:45.438908 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 503/1004] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:45 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1405 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:46.447471 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a19a3661-a044-470a-93b6-4a03fb69b9db tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] Calling method '.version_select at 0x7f501623d160>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:46.457781 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8bd13466-01dc-49c3-8dcf-97601aedeea3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:46.458696 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8bd13466-01dc-49c3-8dcf-97601aedeea3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:46.471666 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8bd13466-01dc-49c3-8dcf-97601aedeea3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:46.472426 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8bd13466-01dc-49c3-8dcf-97601aedeea3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:46.473054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8bd13466-01dc-49c3-8dcf-97601aedeea3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:46.475321 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8bd13466-01dc-49c3-8dcf-97601aedeea3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:46.477229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8bd13466-01dc-49c3-8dcf-97601aedeea3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:46.478303 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8bd13466-01dc-49c3-8dcf-97601aedeea3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:46.509546 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:46.555333 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a19a3661-a044-470a-93b6-4a03fb69b9db tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c5e19dda-47d1-4ece-b663-6d3a2be932af" status: 200 len: 351 microversion: 2.1 time: 0.113943 Aug 08 16:59:46.571971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 502/1005] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:59:46 2022] GET /compute/v2.1/os-volumes/c5e19dda-47d1-4ece-b663-6d3a2be932af => generated 351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:46.803911 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8bd13466-01dc-49c3-8dcf-97601aedeea3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:46.826738 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8bd13466-01dc-49c3-8dcf-97601aedeea3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:46.833723 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8bd13466-01dc-49c3-8dcf-97601aedeea3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:46.835350 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-8bd13466-01dc-49c3-8dcf-97601aedeea3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1405 microversion: 2.20 time: 0.381875 Aug 08 16:59:46.836414 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 504/1006] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:46 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1405 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 16:59:47.884069 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e441f797-ad94-475d-b23b-d23aff249eb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:47.884838 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e441f797-ad94-475d-b23b-d23aff249eb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:47.891615 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e441f797-ad94-475d-b23b-d23aff249eb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:47.892105 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e441f797-ad94-475d-b23b-d23aff249eb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:47.892582 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e441f797-ad94-475d-b23b-d23aff249eb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:47.893306 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e441f797-ad94-475d-b23b-d23aff249eb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:47.893985 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e441f797-ad94-475d-b23b-d23aff249eb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:47.894390 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e441f797-ad94-475d-b23b-d23aff249eb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:48.090948 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e441f797-ad94-475d-b23b-d23aff249eb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:48.108314 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e441f797-ad94-475d-b23b-d23aff249eb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:48.111018 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e441f797-ad94-475d-b23b-d23aff249eb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:48.114724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e441f797-ad94-475d-b23b-d23aff249eb8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1597 microversion: 2.20 time: 0.235403 Aug 08 16:59:48.115781 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 503/1007] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 16:59:47 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1597 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 16:59:48.155117 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5326425c-997f-4bbf-9cdd-3c1902a4b051 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:48.155990 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5326425c-997f-4bbf-9cdd-3c1902a4b051 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:48.171916 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5326425c-997f-4bbf-9cdd-3c1902a4b051 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:48.172417 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5326425c-997f-4bbf-9cdd-3c1902a4b051 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:48.173042 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5326425c-997f-4bbf-9cdd-3c1902a4b051 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:48.174098 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5326425c-997f-4bbf-9cdd-3c1902a4b051 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:48.175491 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5326425c-997f-4bbf-9cdd-3c1902a4b051 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:48.176190 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5326425c-997f-4bbf-9cdd-3c1902a4b051 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:48.203273 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1199123043", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13e31057-f543-4337-919e-432a457bba76"}], "security_groups": [{"name": "tempest-securitygroup--1667309284"}], "key_name": "tempest-keypair-1707161265", "user_data": "}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:48.348357 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.network.neutron [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] validate_networks() for [('13e31057-f543-4337-919e-432a457bba76', None, None, None, None, None)] {{(pid=130235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 16:59:48.382296 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5326425c-997f-4bbf-9cdd-3c1902a4b051 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.236173 Aug 08 16:59:48.396145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 505/1008] 10.222.0.13 () {60 vars in 1316 bytes} [Mon Aug 8 16:59:48 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/os-interface => generated 284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 16:59:48.759068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-931b2a54-05fa-457d-b7d1-0d6c68ea48fd tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] Calling method '.version_select at 0x7f50161f6ee0>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:48.859927 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-931b2a54-05fa-457d-b7d1-0d6c68ea48fd tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/968685de-8765-44b7-897d-cb059f92cd5b" status: 200 len: 350 microversion: 2.1 time: 0.108663 Aug 08 16:59:48.861179 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 506/1009] 10.222.0.13 () {58 vars in 1245 bytes} [Mon Aug 8 16:59:48 2022] GET /compute/v2.1/os-volumes/968685de-8765-44b7-897d-cb059f92cd5b => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:48.880300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0cf71905-e08f-45b0-8a75-814a9cd0655b tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] Calling method '.version_select at 0x7f50161f6d30>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:48.994935 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Flavor limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 16:59:48.995509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Image limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 16:59:48.995907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Flavor pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 16:59:48.996329 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Image pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 16:59:48.996752 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 16:59:49.009026 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0cf71905-e08f-45b0-8a75-814a9cd0655b tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.132618 Aug 08 16:59:49.009693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 507/1010] 10.222.0.13 () {58 vars in 1134 bytes} [Mon Aug 8 16:59:48 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:59:49.021336 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:49.022641 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:49.024088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:49.025118 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:49.025908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:49.026455 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:49.029144 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-82ae270a-1bcf-4e47-81d6-3fca9b14e776 tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] Calling method '.version_select at 0x7f501a93b0d0>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:49.049622 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for project b2063a114c1942cab80ae4b708be9ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 16:59:49.055826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Getting quotas for user fdb16e7edbe143e9b96325842896f04e and project b2063a114c1942cab80ae4b708be9ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 16:59:49.074935 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Going to run 1 instances... {{(pid=130235) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 16:59:49.079085 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 16:59:49.159568 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-82ae270a-1bcf-4e47-81d6-3fca9b14e776 tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.135554 Aug 08 16:59:49.167098 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 508/1011] 10.222.0.13 () {58 vars in 1149 bytes} [Mon Aug 8 16:59:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:49.187828 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0dd91cd1-f911-4016-9854-5fef6b76ce23 tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] Calling method '.version_select at 0x7f501a93b280>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:49.219276 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-106441f2-c1bc-4508-ae61-66d6f5ad5014 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.021963 Aug 08 16:59:49.220208 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 504/1012] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 16:59:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 16:59:49.242068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-eb7625ae-e2cb-4b9a-a7fe-3600ee127f9c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:49.243118 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-eb7625ae-e2cb-4b9a-a7fe-3600ee127f9c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:49.364962 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0dd91cd1-f911-4016-9854-5fef6b76ce23 tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.184802 Aug 08 16:59:49.365792 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 509/1013] 10.222.0.13 () {58 vars in 1134 bytes} [Mon Aug 8 16:59:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:49.377925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-eb7625ae-e2cb-4b9a-a7fe-3600ee127f9c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:49.391208 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-928fab12-55d4-46c1-9476-13133c874d9c tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] Calling method '.version_select at 0x7f501a9ccdc0>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:49.406084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-eb7625ae-e2cb-4b9a-a7fe-3600ee127f9c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1242 microversion: 2.1 time: 0.173540 Aug 08 16:59:49.422338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 505/1014] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:49 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1242 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:49.560408 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-928fab12-55d4-46c1-9476-13133c874d9c tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.178467 Aug 08 16:59:49.564199 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 510/1015] 10.222.0.13 () {58 vars in 1167 bytes} [Mon Aug 8 16:59:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:49.585336 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d0df3d2d-abc6-4615-ab89-488d6d54e5b4 tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] Calling method '.version_select at 0x7f501623d5e0>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:49.690386 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d0df3d2d-abc6-4615-ab89-488d6d54e5b4 tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.110250 Aug 08 16:59:49.691036 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 506/1016] 10.222.0.13 () {58 vars in 1170 bytes} [Mon Aug 8 16:59:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:49.717747 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6a46496a-cd61-496b-95e9-e05e1b38077e tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] Calling method '.version_select at 0x7f50161f6ca0>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:49.832000 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6a46496a-cd61-496b-95e9-e05e1b38077e tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.121660 Aug 08 16:59:49.845202 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 511/1017] 10.222.0.13 () {58 vars in 1155 bytes} [Mon Aug 8 16:59:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:49.863948 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-70aa474b-7080-4ca9-8d49-ed91e03964ac tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] Calling method '.version_select at 0x7f501615db80>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:50.030492 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-70aa474b-7080-4ca9-8d49-ed91e03964ac tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.177947 Aug 08 16:59:50.049793 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 507/1018] 10.222.0.13 () {58 vars in 1188 bytes} [Mon Aug 8 16:59:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:50.071927 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6a750bb0-e78a-4336-9b8a-a43c89a6cee4 tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] Calling method '.version_select at 0x7f50164509d0>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:50.251109 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6a750bb0-e78a-4336-9b8a-a43c89a6cee4 tempest-VolumesTestJSON-2055299720 tempest-VolumesTestJSON-2055299720-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.196501 Aug 08 16:59:50.253808 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 512/1019] 10.222.0.13 () {58 vars in 1155 bytes} [Mon Aug 8 16:59:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:50.390478 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-1a3b580e-5e4e-4d7e-bb56-e70f355d65fc req-f7e5a919-2d43-4967-b895-e7cc38871f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37eeb765-0b75-4da4-be22-9fc72927ff6a", "tag": "25f9ae20-5161-4130-bc9b-d7c23e20ddc0"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:50.410841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-1a3b580e-5e4e-4d7e-bb56-e70f355d65fc req-f7e5a919-2d43-4967-b895-e7cc38871f48 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:50.411828 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-1a3b580e-5e4e-4d7e-bb56-e70f355d65fc req-f7e5a919-2d43-4967-b895-e7cc38871f48 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:50.412751 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-1a3b580e-5e4e-4d7e-bb56-e70f355d65fc req-f7e5a919-2d43-4967-b895-e7cc38871f48 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:50.431455 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0fc673ab-45cc-4305-ab0e-7f37e6ea2afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:50.432651 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0fc673ab-45cc-4305-ab0e-7f37e6ea2afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:50.436216 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-1a3b580e-5e4e-4d7e-bb56-e70f355d65fc req-f7e5a919-2d43-4967-b895-e7cc38871f48 service nova] Creating event network-changed:25f9ae20-5161-4130-bc9b-d7c23e20ddc0 for instance 37eeb765-0b75-4da4-be22-9fc72927ff6a on hv-cinder-85220 Aug 08 16:59:50.449579 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-1a3b580e-5e4e-4d7e-bb56-e70f355d65fc req-f7e5a919-2d43-4967-b895-e7cc38871f48 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063596 Aug 08 16:59:50.452894 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 508/1020] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:50.461119 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fc673ab-45cc-4305-ab0e-7f37e6ea2afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:50.463911 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fc673ab-45cc-4305-ab0e-7f37e6ea2afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:50.466038 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fc673ab-45cc-4305-ab0e-7f37e6ea2afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:50.467361 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fc673ab-45cc-4305-ab0e-7f37e6ea2afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:50.468441 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fc673ab-45cc-4305-ab0e-7f37e6ea2afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:50.469446 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fc673ab-45cc-4305-ab0e-7f37e6ea2afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:50.708736 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0fc673ab-45cc-4305-ab0e-7f37e6ea2afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:50.722320 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0fc673ab-45cc-4305-ab0e-7f37e6ea2afb tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1246 microversion: 2.1 time: 0.295144 Aug 08 16:59:50.723910 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 513/1021] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:50 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1246 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:59:51.768137 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-21d4cf85-6f92-451e-9a7e-4ca605477f4d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:51.769333 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-21d4cf85-6f92-451e-9a7e-4ca605477f4d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:51.780763 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-21d4cf85-6f92-451e-9a7e-4ca605477f4d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:51.781643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-21d4cf85-6f92-451e-9a7e-4ca605477f4d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:51.782420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-21d4cf85-6f92-451e-9a7e-4ca605477f4d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:51.784998 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-21d4cf85-6f92-451e-9a7e-4ca605477f4d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:51.785747 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-21d4cf85-6f92-451e-9a7e-4ca605477f4d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:51.786441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-21d4cf85-6f92-451e-9a7e-4ca605477f4d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:51.911280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-21d4cf85-6f92-451e-9a7e-4ca605477f4d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:51.925942 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-21d4cf85-6f92-451e-9a7e-4ca605477f4d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1294 microversion: 2.1 time: 0.166840 Aug 08 16:59:51.927056 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 509/1022] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:51 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1294 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:52.141367 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-dacee534-638d-46cd-b24e-f0431efc5c51 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:52.143545 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-dacee534-638d-46cd-b24e-f0431efc5c51 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:52.167042 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dacee534-638d-46cd-b24e-f0431efc5c51 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:52.168454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dacee534-638d-46cd-b24e-f0431efc5c51 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:52.169390 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dacee534-638d-46cd-b24e-f0431efc5c51 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:52.171559 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dacee534-638d-46cd-b24e-f0431efc5c51 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:52.172435 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dacee534-638d-46cd-b24e-f0431efc5c51 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:52.173245 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dacee534-638d-46cd-b24e-f0431efc5c51 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:52.298770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-dacee534-638d-46cd-b24e-f0431efc5c51 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/ips" status: 200 len: 146 microversion: 2.1 time: 0.166425 Aug 08 16:59:52.300524 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 514/1023] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Aug 8 16:59:52 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/ips => generated 146 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:52.955735 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-820af7ae-ebc2-47e5-a187-85019c6ef53a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:52.961847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-820af7ae-ebc2-47e5-a187-85019c6ef53a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:52.976374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-820af7ae-ebc2-47e5-a187-85019c6ef53a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:52.977665 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-820af7ae-ebc2-47e5-a187-85019c6ef53a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:52.978843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-820af7ae-ebc2-47e5-a187-85019c6ef53a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:52.981873 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-820af7ae-ebc2-47e5-a187-85019c6ef53a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:52.984034 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-820af7ae-ebc2-47e5-a187-85019c6ef53a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:52.986608 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-820af7ae-ebc2-47e5-a187-85019c6ef53a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:53.137816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-820af7ae-ebc2-47e5-a187-85019c6ef53a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:53.147006 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-820af7ae-ebc2-47e5-a187-85019c6ef53a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1300 microversion: 2.1 time: 0.199901 Aug 08 16:59:53.147612 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 510/1024] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:52 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1300 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:54.184099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1a1f8b47-41c7-4965-93a5-aadba6872f70 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:54.185528 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1a1f8b47-41c7-4965-93a5-aadba6872f70 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:54.192765 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=4 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:54.195203 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1a1f8b47-41c7-4965-93a5-aadba6872f70 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:54.196028 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1a1f8b47-41c7-4965-93a5-aadba6872f70 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:54.196707 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1a1f8b47-41c7-4965-93a5-aadba6872f70 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:54.197809 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1a1f8b47-41c7-4965-93a5-aadba6872f70 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:54.198495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1a1f8b47-41c7-4965-93a5-aadba6872f70 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:54.199173 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1a1f8b47-41c7-4965-93a5-aadba6872f70 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:54.525856 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c0ce93fc-41d1-4aec-ad77-b351731acec5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd315a09-c28b-4bba-a587-184340fc5168"}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:54.528551 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c0ce93fc-41d1-4aec-ad77-b351731acec5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:54.537881 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0ce93fc-41d1-4aec-ad77-b351731acec5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:54.538825 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0ce93fc-41d1-4aec-ad77-b351731acec5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:54.539628 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0ce93fc-41d1-4aec-ad77-b351731acec5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:54.540923 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0ce93fc-41d1-4aec-ad77-b351731acec5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:54.541894 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0ce93fc-41d1-4aec-ad77-b351731acec5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:54.542724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0ce93fc-41d1-4aec-ad77-b351731acec5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:54.626017 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1a1f8b47-41c7-4965-93a5-aadba6872f70 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:54.638270 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1a1f8b47-41c7-4965-93a5-aadba6872f70 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1368 microversion: 2.1 time: 0.457677 Aug 08 16:59:54.638270 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 515/1025] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:54 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1368 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:55.593378 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-a90a1d2a-867d-477c-b6a6-056d550bed63 req-c2392a7c-2d28-4bf8-bac1-45e429f72806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54deb65a-9be6-4c56-921e-b4ce8d6102c0", "tag": "43c96a20-b7b5-40d0-ac3b-42931066c51c"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 16:59:55.611533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c0ce93fc-41d1-4aec-ad77-b351731acec5 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "POST /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.089487 Aug 08 16:59:55.615824 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 511/1026] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 16:59:54 2022] POST /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments => generated 194 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 16:59:55.631684 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-a90a1d2a-867d-477c-b6a6-056d550bed63 req-c2392a7c-2d28-4bf8-bac1-45e429f72806 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:55.632176 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-a90a1d2a-867d-477c-b6a6-056d550bed63 req-c2392a7c-2d28-4bf8-bac1-45e429f72806 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:55.633285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-a90a1d2a-867d-477c-b6a6-056d550bed63 req-c2392a7c-2d28-4bf8-bac1-45e429f72806 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:55.651959 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-a90a1d2a-867d-477c-b6a6-056d550bed63 req-c2392a7c-2d28-4bf8-bac1-45e429f72806 service nova] Creating event network-changed:43c96a20-b7b5-40d0-ac3b-42931066c51c for instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 on hv-cinder-85220 Aug 08 16:59:55.661223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-a90a1d2a-867d-477c-b6a6-056d550bed63 req-c2392a7c-2d28-4bf8-bac1-45e429f72806 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074625 Aug 08 16:59:55.662831 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 516/1027] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 16:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 16:59:55.676130 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-dcfa59ce-18dd-4686-8082-6a9736b9206d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:55.677449 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-dcfa59ce-18dd-4686-8082-6a9736b9206d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:55.700906 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dcfa59ce-18dd-4686-8082-6a9736b9206d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:55.701762 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dcfa59ce-18dd-4686-8082-6a9736b9206d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:55.702554 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dcfa59ce-18dd-4686-8082-6a9736b9206d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:55.721983 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dcfa59ce-18dd-4686-8082-6a9736b9206d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:55.728514 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dcfa59ce-18dd-4686-8082-6a9736b9206d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:55.729443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dcfa59ce-18dd-4686-8082-6a9736b9206d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:56.099392 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-dcfa59ce-18dd-4686-8082-6a9736b9206d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:56.122121 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-dcfa59ce-18dd-4686-8082-6a9736b9206d tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1368 microversion: 2.1 time: 0.451160 Aug 08 16:59:56.123070 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 512/1028] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:55 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1368 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:59:57.157143 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e0971cc5-7ed3-4542-9546-e416faab5461 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:57.160268 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e0971cc5-7ed3-4542-9546-e416faab5461 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:57.182951 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e0971cc5-7ed3-4542-9546-e416faab5461 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:57.194867 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e0971cc5-7ed3-4542-9546-e416faab5461 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:57.195728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e0971cc5-7ed3-4542-9546-e416faab5461 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:57.197790 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e0971cc5-7ed3-4542-9546-e416faab5461 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:57.201433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e0971cc5-7ed3-4542-9546-e416faab5461 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:57.202183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e0971cc5-7ed3-4542-9546-e416faab5461 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:57.543683 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e0971cc5-7ed3-4542-9546-e416faab5461 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:57.559606 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e0971cc5-7ed3-4542-9546-e416faab5461 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1368 microversion: 2.1 time: 0.416964 Aug 08 16:59:57.563424 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 517/1029] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:57 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1368 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 16:59:58.593986 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-10506692-71c7-4117-964d-5c0fbfff0a9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:58.594777 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-10506692-71c7-4117-964d-5c0fbfff0a9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:58.603578 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-10506692-71c7-4117-964d-5c0fbfff0a9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:58.604716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-10506692-71c7-4117-964d-5c0fbfff0a9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:58.605426 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-10506692-71c7-4117-964d-5c0fbfff0a9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:58.606433 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-10506692-71c7-4117-964d-5c0fbfff0a9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:58.607213 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-10506692-71c7-4117-964d-5c0fbfff0a9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:58.608188 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-10506692-71c7-4117-964d-5c0fbfff0a9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:58.831488 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-10506692-71c7-4117-964d-5c0fbfff0a9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 16:59:58.844002 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-10506692-71c7-4117-964d-5c0fbfff0a9a tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1368 microversion: 2.1 time: 0.253528 Aug 08 16:59:58.845084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 513/1030] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:58 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 16:59:59.867760 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-23f8e3e2-993e-4c91-81db-fe698cd6e7c4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 16:59:59.868542 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-23f8e3e2-993e-4c91-81db-fe698cd6e7c4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 16:59:59.873667 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 16:59:59.878778 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-23f8e3e2-993e-4c91-81db-fe698cd6e7c4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:59.879288 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-23f8e3e2-993e-4c91-81db-fe698cd6e7c4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:59.879732 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-23f8e3e2-993e-4c91-81db-fe698cd6e7c4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 16:59:59.880451 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-23f8e3e2-993e-4c91-81db-fe698cd6e7c4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 16:59:59.881114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-23f8e3e2-993e-4c91-81db-fe698cd6e7c4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 16:59:59.881543 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-23f8e3e2-993e-4c91-81db-fe698cd6e7c4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:00.131851 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-23f8e3e2-993e-4c91-81db-fe698cd6e7c4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:00.143257 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-23f8e3e2-993e-4c91-81db-fe698cd6e7c4 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1368 microversion: 2.1 time: 0.278189 Aug 08 17:00:00.144371 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 518/1031] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 16:59:59 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:01.174669 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ae9aaec9-d8fa-4381-bed5-df2c1286bf8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:01.175584 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ae9aaec9-d8fa-4381-bed5-df2c1286bf8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:01.178700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:01.179435 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=8 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:01.183994 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae9aaec9-d8fa-4381-bed5-df2c1286bf8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:01.184482 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae9aaec9-d8fa-4381-bed5-df2c1286bf8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:01.185125 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae9aaec9-d8fa-4381-bed5-df2c1286bf8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:01.186086 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae9aaec9-d8fa-4381-bed5-df2c1286bf8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:01.186773 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae9aaec9-d8fa-4381-bed5-df2c1286bf8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:01.187205 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ae9aaec9-d8fa-4381-bed5-df2c1286bf8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:01.402463 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ae9aaec9-d8fa-4381-bed5-df2c1286bf8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:01.412430 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ae9aaec9-d8fa-4381-bed5-df2c1286bf8e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1368 microversion: 2.1 time: 0.242702 Aug 08 17:00:01.423487 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 514/1032] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:01 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:02.462337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7c393019-908a-44b7-a2af-7855ac2a7595 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:02.463501 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7c393019-908a-44b7-a2af-7855ac2a7595 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:02.479408 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7c393019-908a-44b7-a2af-7855ac2a7595 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:02.483298 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7c393019-908a-44b7-a2af-7855ac2a7595 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:02.484150 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7c393019-908a-44b7-a2af-7855ac2a7595 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:02.488207 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7c393019-908a-44b7-a2af-7855ac2a7595 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:02.488942 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7c393019-908a-44b7-a2af-7855ac2a7595 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:02.491681 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7c393019-908a-44b7-a2af-7855ac2a7595 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:02.711780 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7c393019-908a-44b7-a2af-7855ac2a7595 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:02.736433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7c393019-908a-44b7-a2af-7855ac2a7595 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1368 microversion: 2.1 time: 0.274619 Aug 08 17:00:02.736433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 519/1033] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:02 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:02.887336 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-f82626dd-4b4a-4442-90ee-a37159772ccd req-be7ec378-e12a-487f-9b11-24459e5da2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54deb65a-9be6-4c56-921e-b4ce8d6102c0", "name": "network-vif-plugged", "status": "completed", "tag": "43c96a20-b7b5-40d0-ac3b-42931066c51c"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:02.901985 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:02.915034 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-f82626dd-4b4a-4442-90ee-a37159772ccd req-be7ec378-e12a-487f-9b11-24459e5da2f6 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:02.916757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-f82626dd-4b4a-4442-90ee-a37159772ccd req-be7ec378-e12a-487f-9b11-24459e5da2f6 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:02.916757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-f82626dd-4b4a-4442-90ee-a37159772ccd req-be7ec378-e12a-487f-9b11-24459e5da2f6 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:02.931461 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-f82626dd-4b4a-4442-90ee-a37159772ccd req-be7ec378-e12a-487f-9b11-24459e5da2f6 service nova] Creating event network-vif-plugged:43c96a20-b7b5-40d0-ac3b-42931066c51c for instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 on hv-cinder-85220 Aug 08 17:00:02.937349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-f82626dd-4b4a-4442-90ee-a37159772ccd req-be7ec378-e12a-487f-9b11-24459e5da2f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064480 Aug 08 17:00:02.941145 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 515/1034] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:03.763146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e2c55b98-605b-4c02-9d92-31a17e5e11f6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:03.763146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e2c55b98-605b-4c02-9d92-31a17e5e11f6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:03.768020 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e2c55b98-605b-4c02-9d92-31a17e5e11f6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:03.768807 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e2c55b98-605b-4c02-9d92-31a17e5e11f6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:03.773697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e2c55b98-605b-4c02-9d92-31a17e5e11f6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:03.773697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e2c55b98-605b-4c02-9d92-31a17e5e11f6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:03.773697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e2c55b98-605b-4c02-9d92-31a17e5e11f6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:03.773697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e2c55b98-605b-4c02-9d92-31a17e5e11f6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:03.937160 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e2c55b98-605b-4c02-9d92-31a17e5e11f6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:03.946000 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e2c55b98-605b-4c02-9d92-31a17e5e11f6 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1368 microversion: 2.1 time: 0.194531 Aug 08 17:00:03.946840 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 520/1035] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:03 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:04.796780 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fa28919f-2eae-4103-8631-1db953f6e6fe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:04.806465 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fa28919f-2eae-4103-8631-1db953f6e6fe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:04.819226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa28919f-2eae-4103-8631-1db953f6e6fe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:04.820636 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa28919f-2eae-4103-8631-1db953f6e6fe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:04.821328 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa28919f-2eae-4103-8631-1db953f6e6fe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:04.822416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa28919f-2eae-4103-8631-1db953f6e6fe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:04.823186 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa28919f-2eae-4103-8631-1db953f6e6fe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:04.823840 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fa28919f-2eae-4103-8631-1db953f6e6fe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:04.889082 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fa28919f-2eae-4103-8631-1db953f6e6fe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101972 Aug 08 17:00:04.890086 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 516/1036] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 17:00:04 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:04.907687 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0ef196ee-7521-4ccc-ab5e-ba8d1f21be18 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:04.907687 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0ef196ee-7521-4ccc-ab5e-ba8d1f21be18 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:04.916025 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ef196ee-7521-4ccc-ab5e-ba8d1f21be18 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:04.916743 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ef196ee-7521-4ccc-ab5e-ba8d1f21be18 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:04.917506 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ef196ee-7521-4ccc-ab5e-ba8d1f21be18 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:04.918790 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ef196ee-7521-4ccc-ab5e-ba8d1f21be18 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:04.919541 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ef196ee-7521-4ccc-ab5e-ba8d1f21be18 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:04.920269 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0ef196ee-7521-4ccc-ab5e-ba8d1f21be18 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:04.962272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0ef196ee-7521-4ccc-ab5e-ba8d1f21be18 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments/cd315a09-c28b-4bba-a587-184340fc5168" status: 200 len: 194 microversion: 2.1 time: 0.061350 Aug 08 17:00:04.968432 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 521/1037] 10.222.0.13 () {58 vars in 1413 bytes} [Mon Aug 8 17:00:04 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments/cd315a09-c28b-4bba-a587-184340fc5168 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:04.969507 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-43747fa7-ecdc-402d-8d85-f1a6ae32fe1f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:04.970861 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-43747fa7-ecdc-402d-8d85-f1a6ae32fe1f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:04.987437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43747fa7-ecdc-402d-8d85-f1a6ae32fe1f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:04.988288 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43747fa7-ecdc-402d-8d85-f1a6ae32fe1f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:04.989083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43747fa7-ecdc-402d-8d85-f1a6ae32fe1f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:04.990433 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43747fa7-ecdc-402d-8d85-f1a6ae32fe1f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:04.991570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43747fa7-ecdc-402d-8d85-f1a6ae32fe1f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:04.992174 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43747fa7-ecdc-402d-8d85-f1a6ae32fe1f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:05.222435 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-43747fa7-ecdc-402d-8d85-f1a6ae32fe1f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:05.231065 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-43747fa7-ecdc-402d-8d85-f1a6ae32fe1f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1368 microversion: 2.1 time: 0.265645 Aug 08 17:00:05.231679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 517/1038] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:04 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:06.254804 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0741a5d2-f6c4-4d2b-a1b1-6c1550200b28 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:06.255458 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0741a5d2-f6c4-4d2b-a1b1-6c1550200b28 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:06.262757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0741a5d2-f6c4-4d2b-a1b1-6c1550200b28 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:06.263235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0741a5d2-f6c4-4d2b-a1b1-6c1550200b28 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:06.263674 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0741a5d2-f6c4-4d2b-a1b1-6c1550200b28 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:06.264424 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0741a5d2-f6c4-4d2b-a1b1-6c1550200b28 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:06.264881 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0741a5d2-f6c4-4d2b-a1b1-6c1550200b28 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:06.265316 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0741a5d2-f6c4-4d2b-a1b1-6c1550200b28 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:06.436523 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0741a5d2-f6c4-4d2b-a1b1-6c1550200b28 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:06.445514 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0741a5d2-f6c4-4d2b-a1b1-6c1550200b28 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1556 microversion: 2.1 time: 0.194809 Aug 08 17:00:06.446267 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 522/1039] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:06 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1556 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:06.468800 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7ee0e796-3384-4fc8-8acf-3b5a6be1267c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:06.469470 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7ee0e796-3384-4fc8-8acf-3b5a6be1267c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:06.480584 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7ee0e796-3384-4fc8-8acf-3b5a6be1267c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:06.481639 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7ee0e796-3384-4fc8-8acf-3b5a6be1267c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:06.482182 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7ee0e796-3384-4fc8-8acf-3b5a6be1267c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:06.483255 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7ee0e796-3384-4fc8-8acf-3b5a6be1267c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:06.483889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7ee0e796-3384-4fc8-8acf-3b5a6be1267c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:06.484469 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7ee0e796-3384-4fc8-8acf-3b5a6be1267c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:06.580888 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7ee0e796-3384-4fc8-8acf-3b5a6be1267c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116310 Aug 08 17:00:06.581565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 518/1040] 10.222.0.13 () {58 vars in 1275 bytes} [Mon Aug 8 17:00:06 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:00:07.887927 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-7d433980-5a4a-494e-b481-4579bb8c6f29 req-5f44c52c-3580-443f-9196-334020aeb2ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54deb65a-9be6-4c56-921e-b4ce8d6102c0", "tag": "43c96a20-b7b5-40d0-ac3b-42931066c51c"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:07.908181 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-7d433980-5a4a-494e-b481-4579bb8c6f29 req-5f44c52c-3580-443f-9196-334020aeb2ee service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:07.909060 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-7d433980-5a4a-494e-b481-4579bb8c6f29 req-5f44c52c-3580-443f-9196-334020aeb2ee service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:07.909922 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-7d433980-5a4a-494e-b481-4579bb8c6f29 req-5f44c52c-3580-443f-9196-334020aeb2ee service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:07.932207 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-7d433980-5a4a-494e-b481-4579bb8c6f29 req-5f44c52c-3580-443f-9196-334020aeb2ee service nova] Creating event network-changed:43c96a20-b7b5-40d0-ac3b-42931066c51c for instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 on hv-cinder-85220 Aug 08 17:00:07.944023 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-7d433980-5a4a-494e-b481-4579bb8c6f29 req-5f44c52c-3580-443f-9196-334020aeb2ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063190 Aug 08 17:00:07.945028 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 523/1041] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:09.226423 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5fb85c9d-3320-4c67-b66b-ffc5ed22d1ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa2c44c7-85de-40ab-a85d-e773a110c181"}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:09.229441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5fb85c9d-3320-4c67-b66b-ffc5ed22d1ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:09.239343 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5fb85c9d-3320-4c67-b66b-ffc5ed22d1ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:09.240110 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5fb85c9d-3320-4c67-b66b-ffc5ed22d1ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:09.243484 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5fb85c9d-3320-4c67-b66b-ffc5ed22d1ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:09.243484 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5fb85c9d-3320-4c67-b66b-ffc5ed22d1ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:09.243484 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5fb85c9d-3320-4c67-b66b-ffc5ed22d1ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:09.243484 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5fb85c9d-3320-4c67-b66b-ffc5ed22d1ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:10.200829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5fb85c9d-3320-4c67-b66b-ffc5ed22d1ab tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "POST /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.980922 Aug 08 17:00:10.201721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 519/1042] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 17:00:09 2022] POST /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments => generated 194 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:18.932153 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=11 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:18.933158 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=65 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:18.941037 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-df2e6875-1a3b-48d8-9f1e-c86fb67d0d83 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:18.944766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-df2e6875-1a3b-48d8-9f1e-c86fb67d0d83 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:18.955031 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-df2e6875-1a3b-48d8-9f1e-c86fb67d0d83 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:18.956121 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-df2e6875-1a3b-48d8-9f1e-c86fb67d0d83 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:18.956659 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-df2e6875-1a3b-48d8-9f1e-c86fb67d0d83 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:18.957406 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-df2e6875-1a3b-48d8-9f1e-c86fb67d0d83 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:18.958433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-df2e6875-1a3b-48d8-9f1e-c86fb67d0d83 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:18.958433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-df2e6875-1a3b-48d8-9f1e-c86fb67d0d83 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:18.995327 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-df2e6875-1a3b-48d8-9f1e-c86fb67d0d83 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.065349 Aug 08 17:00:18.995995 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 524/1043] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 17:00:18 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments => generated 371 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:19.145416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-58d404ea-6ea9-4341-9076-088dfa6148b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:19.146158 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-58d404ea-6ea9-4341-9076-088dfa6148b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:19.152762 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-58d404ea-6ea9-4341-9076-088dfa6148b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:19.153255 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-58d404ea-6ea9-4341-9076-088dfa6148b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:19.153694 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-58d404ea-6ea9-4341-9076-088dfa6148b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:19.154401 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-58d404ea-6ea9-4341-9076-088dfa6148b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:19.154886 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-58d404ea-6ea9-4341-9076-088dfa6148b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:19.155334 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-58d404ea-6ea9-4341-9076-088dfa6148b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:19.159506 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:19.191110 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-58d404ea-6ea9-4341-9076-088dfa6148b6 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments/cd315a09-c28b-4bba-a587-184340fc5168" status: 200 len: 194 microversion: 2.1 time: 0.051966 Aug 08 17:00:19.191803 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 520/1044] 10.222.0.13 () {58 vars in 1413 bytes} [Mon Aug 8 17:00:19 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments/cd315a09-c28b-4bba-a587-184340fc5168 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:19.207438 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7ed518b2-e88b-48f1-9b5d-028b9a91a2a9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:19.207948 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7ed518b2-e88b-48f1-9b5d-028b9a91a2a9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:19.215518 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7ed518b2-e88b-48f1-9b5d-028b9a91a2a9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:19.216022 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7ed518b2-e88b-48f1-9b5d-028b9a91a2a9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:19.216470 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7ed518b2-e88b-48f1-9b5d-028b9a91a2a9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:19.217202 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7ed518b2-e88b-48f1-9b5d-028b9a91a2a9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:19.217671 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7ed518b2-e88b-48f1-9b5d-028b9a91a2a9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:19.218108 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7ed518b2-e88b-48f1-9b5d-028b9a91a2a9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:19.326412 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-7ed518b2-e88b-48f1-9b5d-028b9a91a2a9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lazy-loading 'services' on Instance uuid 22dcddde-2c2c-4300-83ee-62dab4e9bb2b {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:00:19.633445 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7ed518b2-e88b-48f1-9b5d-028b9a91a2a9 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "DELETE /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments/cd315a09-c28b-4bba-a587-184340fc5168" status: 202 len: 0 microversion: 2.1 time: 0.431231 Aug 08 17:00:19.634043 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 525/1045] 10.222.0.13 () {58 vars in 1416 bytes} [Mon Aug 8 17:00:19 2022] DELETE /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments/cd315a09-c28b-4bba-a587-184340fc5168 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:00:21.849760 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a7dff79a-888c-45f3-9e1c-9815aea5f2ff tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:21.850475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a7dff79a-888c-45f3-9e1c-9815aea5f2ff tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:21.857909 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7dff79a-888c-45f3-9e1c-9815aea5f2ff tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:21.858390 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7dff79a-888c-45f3-9e1c-9815aea5f2ff tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:21.858880 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7dff79a-888c-45f3-9e1c-9815aea5f2ff tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:21.859617 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7dff79a-888c-45f3-9e1c-9815aea5f2ff tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:21.860685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7dff79a-888c-45f3-9e1c-9815aea5f2ff tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:21.861122 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7dff79a-888c-45f3-9e1c-9815aea5f2ff tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:21.895370 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a7dff79a-888c-45f3-9e1c-9815aea5f2ff tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments/aa2c44c7-85de-40ab-a85d-e773a110c181" status: 200 len: 194 microversion: 2.1 time: 0.050813 Aug 08 17:00:21.896006 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 521/1046] 10.222.0.13 () {58 vars in 1413 bytes} [Mon Aug 8 17:00:21 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments/aa2c44c7-85de-40ab-a85d-e773a110c181 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:21.908797 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4c053979-262c-4bb6-bdb0-b32a87878865 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:21.909494 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4c053979-262c-4bb6-bdb0-b32a87878865 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:21.916217 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4c053979-262c-4bb6-bdb0-b32a87878865 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:21.916711 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4c053979-262c-4bb6-bdb0-b32a87878865 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:21.917157 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4c053979-262c-4bb6-bdb0-b32a87878865 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:21.917871 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4c053979-262c-4bb6-bdb0-b32a87878865 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:21.918331 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4c053979-262c-4bb6-bdb0-b32a87878865 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:21.918801 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4c053979-262c-4bb6-bdb0-b32a87878865 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:22.030607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-4c053979-262c-4bb6-bdb0-b32a87878865 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lazy-loading 'services' on Instance uuid 22dcddde-2c2c-4300-83ee-62dab4e9bb2b {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:00:22.295453 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4c053979-262c-4bb6-bdb0-b32a87878865 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "DELETE /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments/aa2c44c7-85de-40ab-a85d-e773a110c181" status: 202 len: 0 microversion: 2.1 time: 0.391807 Aug 08 17:00:22.295976 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 526/1047] 10.222.0.13 () {58 vars in 1416 bytes} [Mon Aug 8 17:00:21 2022] DELETE /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments/aa2c44c7-85de-40ab-a85d-e773a110c181 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:00:24.595784 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d18447e1-c2a6-4ff0-82c1-d1c8f0d549a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:24.601330 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d18447e1-c2a6-4ff0-82c1-d1c8f0d549a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:24.611765 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d18447e1-c2a6-4ff0-82c1-d1c8f0d549a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:24.612639 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d18447e1-c2a6-4ff0-82c1-d1c8f0d549a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:24.613601 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d18447e1-c2a6-4ff0-82c1-d1c8f0d549a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:24.614807 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d18447e1-c2a6-4ff0-82c1-d1c8f0d549a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:24.615595 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d18447e1-c2a6-4ff0-82c1-d1c8f0d549a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:24.616334 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d18447e1-c2a6-4ff0-82c1-d1c8f0d549a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:24.676558 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d18447e1-c2a6-4ff0-82c1-d1c8f0d549a2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089275 Aug 08 17:00:24.677568 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 522/1048] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 17:00:24 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 17:00:24.857053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3c101e2a-477c-4f7a-b04b-3332d63f4198 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:24.859794 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3c101e2a-477c-4f7a-b04b-3332d63f4198 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:24.867164 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3c101e2a-477c-4f7a-b04b-3332d63f4198 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:24.869384 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3c101e2a-477c-4f7a-b04b-3332d63f4198 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:24.869384 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3c101e2a-477c-4f7a-b04b-3332d63f4198 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:24.869384 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3c101e2a-477c-4f7a-b04b-3332d63f4198 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:24.869858 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3c101e2a-477c-4f7a-b04b-3332d63f4198 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:24.870419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3c101e2a-477c-4f7a-b04b-3332d63f4198 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:24.905367 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3c101e2a-477c-4f7a-b04b-3332d63f4198 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053139 Aug 08 17:00:24.906116 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 527/1049] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 17:00:24 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 17:00:25.011310 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a906b537-eb77-4869-b3c6-12e3e1a75961 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:25.012178 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a906b537-eb77-4869-b3c6-12e3e1a75961 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:25.022897 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a906b537-eb77-4869-b3c6-12e3e1a75961 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:25.023781 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a906b537-eb77-4869-b3c6-12e3e1a75961 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:25.024572 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a906b537-eb77-4869-b3c6-12e3e1a75961 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:25.025874 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a906b537-eb77-4869-b3c6-12e3e1a75961 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:25.026724 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a906b537-eb77-4869-b3c6-12e3e1a75961 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:25.027473 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a906b537-eb77-4869-b3c6-12e3e1a75961 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:25.072826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a906b537-eb77-4869-b3c6-12e3e1a75961 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Going to try to terminate instance {{(pid=130235) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:00:25.446243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a906b537-eb77-4869-b3c6-12e3e1a75961 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "DELETE /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 204 len: 0 microversion: 2.1 time: 0.441782 Aug 08 17:00:25.447089 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 523/1050] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:00:25 2022] DELETE /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:00:25.456881 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a92718d4-1608-49c5-9f9d-ba3de4f222cd tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:25.457720 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a92718d4-1608-49c5-9f9d-ba3de4f222cd tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:25.465371 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a92718d4-1608-49c5-9f9d-ba3de4f222cd tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:25.465895 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a92718d4-1608-49c5-9f9d-ba3de4f222cd tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:25.466342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a92718d4-1608-49c5-9f9d-ba3de4f222cd tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:25.467112 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a92718d4-1608-49c5-9f9d-ba3de4f222cd tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:25.467580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a92718d4-1608-49c5-9f9d-ba3de4f222cd tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:25.468017 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a92718d4-1608-49c5-9f9d-ba3de4f222cd tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:25.628936 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a92718d4-1608-49c5-9f9d-ba3de4f222cd tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:25.637904 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a92718d4-1608-49c5-9f9d-ba3de4f222cd tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1671 microversion: 2.1 time: 0.185763 Aug 08 17:00:25.638500 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 528/1051] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:25 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1671 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:26.661912 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c0a1ac03-0d84-463b-9fff-ea9c4357654b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:26.662889 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c0a1ac03-0d84-463b-9fff-ea9c4357654b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:26.669998 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0a1ac03-0d84-463b-9fff-ea9c4357654b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:26.674707 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0a1ac03-0d84-463b-9fff-ea9c4357654b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:26.674707 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0a1ac03-0d84-463b-9fff-ea9c4357654b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:26.674707 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0a1ac03-0d84-463b-9fff-ea9c4357654b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:26.674707 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0a1ac03-0d84-463b-9fff-ea9c4357654b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:26.675391 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c0a1ac03-0d84-463b-9fff-ea9c4357654b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:26.845415 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c0a1ac03-0d84-463b-9fff-ea9c4357654b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:26.854964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c0a1ac03-0d84-463b-9fff-ea9c4357654b tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1671 microversion: 2.1 time: 0.198252 Aug 08 17:00:26.855570 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 524/1052] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:26 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1671 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:27.879901 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-86b2c733-fe58-4f43-8418-c3691b1146ee tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:27.880697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-86b2c733-fe58-4f43-8418-c3691b1146ee tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:27.887933 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86b2c733-fe58-4f43-8418-c3691b1146ee tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:27.888423 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86b2c733-fe58-4f43-8418-c3691b1146ee tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:27.889063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86b2c733-fe58-4f43-8418-c3691b1146ee tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:27.889778 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86b2c733-fe58-4f43-8418-c3691b1146ee tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:27.890425 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86b2c733-fe58-4f43-8418-c3691b1146ee tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:27.891130 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-86b2c733-fe58-4f43-8418-c3691b1146ee tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:28.072773 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-86b2c733-fe58-4f43-8418-c3691b1146ee tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:28.084743 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-86b2c733-fe58-4f43-8418-c3691b1146ee tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1671 microversion: 2.1 time: 0.209919 Aug 08 17:00:28.085503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 529/1053] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:27 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1671 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:00:28.779765 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-db2c118a-005b-4453-945a-ce9bbe244bee req-2ec39558-2024-4b39-9c7a-ad5fdab1ef7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22dcddde-2c2c-4300-83ee-62dab4e9bb2b", "name": "network-vif-deleted", "tag": "5534e07d-dc1b-4632-a0a2-2a150667e474"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:28.790014 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-db2c118a-005b-4453-945a-ce9bbe244bee req-2ec39558-2024-4b39-9c7a-ad5fdab1ef7c service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:28.790513 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-db2c118a-005b-4453-945a-ce9bbe244bee req-2ec39558-2024-4b39-9c7a-ad5fdab1ef7c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:28.790984 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-db2c118a-005b-4453-945a-ce9bbe244bee req-2ec39558-2024-4b39-9c7a-ad5fdab1ef7c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:28.804797 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-db2c118a-005b-4453-945a-ce9bbe244bee req-2ec39558-2024-4b39-9c7a-ad5fdab1ef7c service nova] Creating event network-vif-deleted:5534e07d-dc1b-4632-a0a2-2a150667e474 for instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b on hv-cinder-85220 Aug 08 17:00:28.810507 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-db2c118a-005b-4453-945a-ce9bbe244bee req-2ec39558-2024-4b39-9c7a-ad5fdab1ef7c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035107 Aug 08 17:00:28.811285 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 525/1054] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:00:29.123184 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:29.124192 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:29.137255 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:29.138099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:29.138769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:29.140423 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:29.142527 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:29.143371 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:29.190208 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:29.191510 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:29.191710 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:29.192435 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lazy-loading 'fault' on Instance uuid 22dcddde-2c2c-4300-83ee-62dab4e9bb2b {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:00:29.245091 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8db3ff64ca44958fd633ba25ee191f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442f2ca88fce4cbab9c01278239b77ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:29.260725 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2d89f2dc-f298-442e-b509-0a8dc302fa46 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 200 len: 1326 microversion: 2.1 time: 0.141947 Aug 08 17:00:29.262268 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 530/1055] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:29 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 1326 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:00:30.289666 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3de6c380-e07a-40b1-be05-5e6adf296760 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:30.290353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-3de6c380-e07a-40b1-be05-5e6adf296760 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:30.297851 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3de6c380-e07a-40b1-be05-5e6adf296760 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:30.298840 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3de6c380-e07a-40b1-be05-5e6adf296760 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:30.299294 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3de6c380-e07a-40b1-be05-5e6adf296760 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:30.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3de6c380-e07a-40b1-be05-5e6adf296760 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:30.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3de6c380-e07a-40b1-be05-5e6adf296760 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:30.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3de6c380-e07a-40b1-be05-5e6adf296760 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:30.316935 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-3de6c380-e07a-40b1-be05-5e6adf296760 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] HTTP exception thrown: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3de6c380-e07a-40b1-be05-5e6adf296760 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Request method failure captured: Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b HTTP/1.1 Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8zz_sgph4OjkDyJGqkA_trzNf4cb7yev6uDvojpLSHACfewopQryGVE08Kw7YWSILrSxZpfVZvLWEyk3LzhXmMTPcSIfU1xHfTP-zmkvwMoMD8vXKvQ-QcKBJ-kgZXoJQluZSKugBhKtqoKdUfqq1g5o2Uzb9J20aQdhDkfeSgKXI Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 442f2ca88fce4cbab9c01278239b77ce Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:00:30.318714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:00:30.321796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_442f2ca88fce4cbab9c01278239b77ce", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:00:30.321796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:30.321796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 442f2ca88fce4cbab9c01278239b77ce Aug 08 17:00:30.321796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:30.321796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeTestJSON-1057712121-project Aug 08 17:00:30.321796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:00:30.321796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:00:30.321796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: 5a8db3ff64ca44958fd633ba25ee191f Aug 08 17:00:30.321796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeTestJSON-1057712121-project Aug 08 17:00:30.321796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:00:30.321796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:30.321796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '22dcddde-2c2c-4300-83ee-62dab4e9bb2b'} Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:30.323565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:30.330835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:30.333051 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3de6c380-e07a-40b1-be05-5e6adf296760 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Returning 404 to user: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:30.333051 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-3de6c380-e07a-40b1-be05-5e6adf296760 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 404 len: 111 microversion: 2.1 time: 0.035755 Aug 08 17:00:30.333051 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 526/1056] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:30 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:00:30.333533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5c2a4d58-82a4-4023-9b0e-464faa0887f2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '.version_select at 0x7f501a9135e0>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:30.533513 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5c2a4d58-82a4-4023-9b0e-464faa0887f2 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-282007553" status: 202 len: 0 microversion: 2.1 time: 0.207607 Aug 08 17:00:30.534113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 531/1057] 10.222.0.13 () {58 vars in 1218 bytes} [Mon Aug 8 17:00:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-282007553 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:00:34.512813 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-203884cf-049d-4918-a9d5-10372629bdbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:34.513429 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-203884cf-049d-4918-a9d5-10372629bdbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:34.520833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-203884cf-049d-4918-a9d5-10372629bdbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:34.521335 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-203884cf-049d-4918-a9d5-10372629bdbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:34.521780 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-203884cf-049d-4918-a9d5-10372629bdbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:34.522499 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-203884cf-049d-4918-a9d5-10372629bdbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:34.523097 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-203884cf-049d-4918-a9d5-10372629bdbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:34.523527 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-203884cf-049d-4918-a9d5-10372629bdbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:34.540187 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-203884cf-049d-4918-a9d5-10372629bdbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] HTTP exception thrown: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-203884cf-049d-4918-a9d5-10372629bdbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Request method failure captured: Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: DELETE /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b HTTP/1.1 Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8zz_sgph4OjkDyJGqkA_trzNf4cb7yev6uDvojpLSHACfewopQryGVE08Kw7YWSILrSxZpfVZvLWEyk3LzhXmMTPcSIfU1xHfTP-zmkvwMoMD8vXKvQ-QcKBJ-kgZXoJQluZSKugBhKtqoKdUfqq1g5o2Uzb9J20aQdhDkfeSgKXI Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 442f2ca88fce4cbab9c01278239b77ce Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:00:34.541774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:00:34.543191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_442f2ca88fce4cbab9c01278239b77ce", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:00:34.543191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:34.543191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 442f2ca88fce4cbab9c01278239b77ce Aug 08 17:00:34.543191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:34.543191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeTestJSON-1057712121-project Aug 08 17:00:34.543191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:00:34.543191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:00:34.543191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: 5a8db3ff64ca44958fd633ba25ee191f Aug 08 17:00:34.543191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeTestJSON-1057712121-project Aug 08 17:00:34.543191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:00:34.543191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:34.543191 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '22dcddde-2c2c-4300-83ee-62dab4e9bb2b'} Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:34.544057 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:34.545701 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:34.547455 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-203884cf-049d-4918-a9d5-10372629bdbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Returning 404 to user: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:34.547455 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-203884cf-049d-4918-a9d5-10372629bdbe tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "DELETE /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 404 len: 111 microversion: 2.1 time: 0.034636 Aug 08 17:00:34.547455 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 527/1058] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:00:34 2022] DELETE /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:00:34.553632 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c556ece2-b94c-4ecc-81a9-981e92761b40 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:34.554252 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c556ece2-b94c-4ecc-81a9-981e92761b40 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: 22dcddde-2c2c-4300-83ee-62dab4e9bb2b] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:34.561861 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c556ece2-b94c-4ecc-81a9-981e92761b40 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:34.563553 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c556ece2-b94c-4ecc-81a9-981e92761b40 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:34.564515 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c556ece2-b94c-4ecc-81a9-981e92761b40 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:34.564710 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c556ece2-b94c-4ecc-81a9-981e92761b40 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:34.565168 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c556ece2-b94c-4ecc-81a9-981e92761b40 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:34.565609 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c556ece2-b94c-4ecc-81a9-981e92761b40 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:34.580762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-c556ece2-b94c-4ecc-81a9-981e92761b40 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] HTTP exception thrown: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c556ece2-b94c-4ecc-81a9-981e92761b40 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Request method failure captured: Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b HTTP/1.1 Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T8zz_sgph4OjkDyJGqkA_trzNf4cb7yev6uDvojpLSHACfewopQryGVE08Kw7YWSILrSxZpfVZvLWEyk3LzhXmMTPcSIfU1xHfTP-zmkvwMoMD8vXKvQ-QcKBJ-kgZXoJQluZSKugBhKtqoKdUfqq1g5o2Uzb9J20aQdhDkfeSgKXI Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: 442f2ca88fce4cbab9c01278239b77ce Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 17:00:34.582462 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 17:00:34.584165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_442f2ca88fce4cbab9c01278239b77ce", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:00:34.584165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:34.584165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: 442f2ca88fce4cbab9c01278239b77ce Aug 08 17:00:34.584165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:34.584165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-AttachVolumeTestJSON-1057712121-project Aug 08 17:00:34.584165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 17:00:34.584165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 17:00:34.584165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: 5a8db3ff64ca44958fd633ba25ee191f Aug 08 17:00:34.584165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-AttachVolumeTestJSON-1057712121-project Aug 08 17:00:34.584165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 17:00:34.584165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:34.584165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': '22dcddde-2c2c-4300-83ee-62dab4e9bb2b'} Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:34.585089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. Aug 08 17:00:34.586594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:00:34.588120 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c556ece2-b94c-4ecc-81a9-981e92761b40 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Returning 404 to user: Instance 22dcddde-2c2c-4300-83ee-62dab4e9bb2b could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:34.588120 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c556ece2-b94c-4ecc-81a9-981e92761b40 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b" status: 404 len: 111 microversion: 2.1 time: 0.034927 Aug 08 17:00:34.588120 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 532/1059] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:34 2022] GET /compute/v2.1/servers/22dcddde-2c2c-4300-83ee-62dab4e9bb2b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:00:34.745961 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fea17473-2cba-466b-a589-62137165dade tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:34.746461 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fea17473-2cba-466b-a589-62137165dade tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:34.754294 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fea17473-2cba-466b-a589-62137165dade tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:34.754971 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fea17473-2cba-466b-a589-62137165dade tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:34.762682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fea17473-2cba-466b-a589-62137165dade tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:34.762682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fea17473-2cba-466b-a589-62137165dade tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:34.762682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fea17473-2cba-466b-a589-62137165dade tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:34.762682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fea17473-2cba-466b-a589-62137165dade tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:34.789554 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fea17473-2cba-466b-a589-62137165dade tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/ips" status: 200 len: 152 microversion: 2.20 time: 0.047803 Aug 08 17:00:34.790161 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 528/1060] 10.222.0.13 () {60 vars in 1289 bytes} [Mon Aug 8 17:00:34 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 17:00:35.898189 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8e862187-4c9d-4d3d-a576-32a9e95523f8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:35.899214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8e862187-4c9d-4d3d-a576-32a9e95523f8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:35.906765 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8e862187-4c9d-4d3d-a576-32a9e95523f8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:35.907584 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8e862187-4c9d-4d3d-a576-32a9e95523f8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:35.907763 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8e862187-4c9d-4d3d-a576-32a9e95523f8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:35.908520 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8e862187-4c9d-4d3d-a576-32a9e95523f8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:35.908951 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8e862187-4c9d-4d3d-a576-32a9e95523f8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:35.909395 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8e862187-4c9d-4d3d-a576-32a9e95523f8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:35.925650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-8e862187-4c9d-4d3d-a576-32a9e95523f8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] HTTP exception thrown: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8e862187-4c9d-4d3d-a576-32a9e95523f8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Request method failure captured: Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: DELETE /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 HTTP/1.1 Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T8zz_sgph4OjkDyJGqkA_trzNf4cb7yev6uDvojpLSHACfewopQryGVE08Kw7YWSILrSxZpfVZvLWEyk3LzhXmMTPcSIfU1xHfTP-zmkvwMoMD8vXKvQ-QcKBJ-kgZXoJQluZSKugBhKtqoKdUfqq1g5o2Uzb9J20aQdhDkfeSgKXI Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: 442f2ca88fce4cbab9c01278239b77ce Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 17:00:35.927521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 17:00:35.932285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_442f2ca88fce4cbab9c01278239b77ce", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:00:35.932285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:35.932285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: 442f2ca88fce4cbab9c01278239b77ce Aug 08 17:00:35.932285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:35.932285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-AttachVolumeTestJSON-1057712121-project Aug 08 17:00:35.932285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 17:00:35.932285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 17:00:35.932285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: 5a8db3ff64ca44958fd633ba25ee191f Aug 08 17:00:35.932285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-AttachVolumeTestJSON-1057712121-project Aug 08 17:00:35.932285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 17:00:35.932285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 17:00:35.932285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': 'cba167d3-4013-4e79-8c84-5a72b458b6f7'} Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:35.935234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 17:00:35.941096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:00:35.946401 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8e862187-4c9d-4d3d-a576-32a9e95523f8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Returning 404 to user: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:35.946401 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-8e862187-4c9d-4d3d-a576-32a9e95523f8 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 404 len: 111 microversion: 2.1 time: 0.035002 Aug 08 17:00:35.946401 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 533/1061] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:00:35 2022] DELETE /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:00:35.948177 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9c8b6950-9f59-43f0-8032-7eb257dc7603 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:35.948177 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9c8b6950-9f59-43f0-8032-7eb257dc7603 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] [instance: cba167d3-4013-4e79-8c84-5a72b458b6f7] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:35.948177 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:35.948177 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9c8b6950-9f59-43f0-8032-7eb257dc7603 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:35.949476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9c8b6950-9f59-43f0-8032-7eb257dc7603 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:35.949476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9c8b6950-9f59-43f0-8032-7eb257dc7603 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:35.949476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9c8b6950-9f59-43f0-8032-7eb257dc7603 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:35.949913 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9c8b6950-9f59-43f0-8032-7eb257dc7603 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:35.950360 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9c8b6950-9f59-43f0-8032-7eb257dc7603 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:35.967487 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-9c8b6950-9f59-43f0-8032-7eb257dc7603 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] HTTP exception thrown: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9c8b6950-9f59-43f0-8032-7eb257dc7603 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Request method failure captured: Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 HTTP/1.1 Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8zz_sgph4OjkDyJGqkA_trzNf4cb7yev6uDvojpLSHACfewopQryGVE08Kw7YWSILrSxZpfVZvLWEyk3LzhXmMTPcSIfU1xHfTP-zmkvwMoMD8vXKvQ-QcKBJ-kgZXoJQluZSKugBhKtqoKdUfqq1g5o2Uzb9J20aQdhDkfeSgKXI Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 442f2ca88fce4cbab9c01278239b77ce Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:00:35.969687 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:00:35.973569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_442f2ca88fce4cbab9c01278239b77ce", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/442f2ca88fce4cbab9c01278239b77ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:00:35.973569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:35.973569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 442f2ca88fce4cbab9c01278239b77ce Aug 08 17:00:35.973569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1057712121 Aug 08 17:00:35.973569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeTestJSON-1057712121-project Aug 08 17:00:35.973569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:00:35.973569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:00:35.973569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: 5a8db3ff64ca44958fd633ba25ee191f Aug 08 17:00:35.973569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeTestJSON-1057712121-project Aug 08 17:00:35.973569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:00:35.973569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 17:00:35.973569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'cba167d3-4013-4e79-8c84-5a72b458b6f7'} Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:00:35.975420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. Aug 08 17:00:35.978437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:00:35.980829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9c8b6950-9f59-43f0-8032-7eb257dc7603 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] Returning 404 to user: Instance cba167d3-4013-4e79-8c84-5a72b458b6f7 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:00:35.980829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9c8b6950-9f59-43f0-8032-7eb257dc7603 tempest-AttachVolumeTestJSON-1057712121 tempest-AttachVolumeTestJSON-1057712121-project] 10.222.0.13 "GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7" status: 404 len: 111 microversion: 2.1 time: 0.037209 Aug 08 17:00:35.980829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 529/1062] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:00:35 2022] GET /compute/v2.1/servers/cba167d3-4013-4e79-8c84-5a72b458b6f7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:00:37.142671 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1916d945-db3c-4549-a7f5-16147c035478 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:37.144301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1916d945-db3c-4549-a7f5-16147c035478 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:37.159280 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1916d945-db3c-4549-a7f5-16147c035478 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:37.160344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1916d945-db3c-4549-a7f5-16147c035478 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:37.160936 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1916d945-db3c-4549-a7f5-16147c035478 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:37.161925 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1916d945-db3c-4549-a7f5-16147c035478 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:37.162527 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1916d945-db3c-4549-a7f5-16147c035478 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:37.163374 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1916d945-db3c-4549-a7f5-16147c035478 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:37.191704 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-1916d945-db3c-4549-a7f5-16147c035478 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lazy-loading 'flavor' on Instance uuid 37eeb765-0b75-4da4-be22-9fc72927ff6a {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:00:37.953909 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1916d945-db3c-4549-a7f5-16147c035478 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "POST /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/action" status: 202 len: 0 microversion: 2.20 time: 0.818123 Aug 08 17:00:37.956198 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 534/1063] 10.222.0.13 () {62 vars in 1319 bytes} [Mon Aug 8 17:00:37 2022] POST /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/action => generated 0 bytes in 823 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 08 17:00:37.980276 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ee79c8ec-9635-4c50-ab64-127ced2a33cd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:37.984183 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ee79c8ec-9635-4c50-ab64-127ced2a33cd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:38.006251 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ee79c8ec-9635-4c50-ab64-127ced2a33cd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:38.007553 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ee79c8ec-9635-4c50-ab64-127ced2a33cd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:38.008611 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ee79c8ec-9635-4c50-ab64-127ced2a33cd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:38.010798 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ee79c8ec-9635-4c50-ab64-127ced2a33cd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:38.012146 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ee79c8ec-9635-4c50-ab64-127ced2a33cd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:38.013152 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ee79c8ec-9635-4c50-ab64-127ced2a33cd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:38.320232 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ee79c8ec-9635-4c50-ab64-127ced2a33cd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:38.332710 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ee79c8ec-9635-4c50-ab64-127ced2a33cd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:38.335866 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ee79c8ec-9635-4c50-ab64-127ced2a33cd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:38.337479 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ee79c8ec-9635-4c50-ab64-127ced2a33cd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.375285 Aug 08 17:00:38.338060 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 530/1064] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:37 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:39.367377 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-01ea3d01-8c1f-4ac0-8f2e-3bc0fffb4199 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:39.368203 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-01ea3d01-8c1f-4ac0-8f2e-3bc0fffb4199 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:39.375844 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01ea3d01-8c1f-4ac0-8f2e-3bc0fffb4199 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:39.376672 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01ea3d01-8c1f-4ac0-8f2e-3bc0fffb4199 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:39.377459 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01ea3d01-8c1f-4ac0-8f2e-3bc0fffb4199 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:39.378496 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01ea3d01-8c1f-4ac0-8f2e-3bc0fffb4199 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:39.378993 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01ea3d01-8c1f-4ac0-8f2e-3bc0fffb4199 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:39.379429 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-01ea3d01-8c1f-4ac0-8f2e-3bc0fffb4199 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:39.542974 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-01ea3d01-8c1f-4ac0-8f2e-3bc0fffb4199 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:39.552554 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-01ea3d01-8c1f-4ac0-8f2e-3bc0fffb4199 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:39.554101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-01ea3d01-8c1f-4ac0-8f2e-3bc0fffb4199 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:39.555356 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-01ea3d01-8c1f-4ac0-8f2e-3bc0fffb4199 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.193892 Aug 08 17:00:39.555938 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 535/1065] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:39 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:40.585201 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b8bda33c-1313-441d-9b9f-71df27aa7cc4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:40.586131 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b8bda33c-1313-441d-9b9f-71df27aa7cc4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:40.648333 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b8bda33c-1313-441d-9b9f-71df27aa7cc4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:40.649374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b8bda33c-1313-441d-9b9f-71df27aa7cc4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:40.650383 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b8bda33c-1313-441d-9b9f-71df27aa7cc4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:40.651743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b8bda33c-1313-441d-9b9f-71df27aa7cc4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:40.652553 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b8bda33c-1313-441d-9b9f-71df27aa7cc4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:40.653446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b8bda33c-1313-441d-9b9f-71df27aa7cc4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:40.923124 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b8bda33c-1313-441d-9b9f-71df27aa7cc4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:40.941958 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b8bda33c-1313-441d-9b9f-71df27aa7cc4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:40.945471 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b8bda33c-1313-441d-9b9f-71df27aa7cc4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:40.947960 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b8bda33c-1313-441d-9b9f-71df27aa7cc4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.369724 Aug 08 17:00:40.949190 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 531/1066] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:40 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:41.989649 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a02d86a6-df3f-427a-a317-f053a8353da6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:41.990277 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a02d86a6-df3f-427a-a317-f053a8353da6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:41.997436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a02d86a6-df3f-427a-a317-f053a8353da6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:41.997941 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a02d86a6-df3f-427a-a317-f053a8353da6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:41.998391 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a02d86a6-df3f-427a-a317-f053a8353da6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:41.999158 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a02d86a6-df3f-427a-a317-f053a8353da6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:41.999665 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a02d86a6-df3f-427a-a317-f053a8353da6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:42.000336 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a02d86a6-df3f-427a-a317-f053a8353da6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:42.167336 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a02d86a6-df3f-427a-a317-f053a8353da6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:42.181769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a02d86a6-df3f-427a-a317-f053a8353da6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:42.185621 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a02d86a6-df3f-427a-a317-f053a8353da6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:42.187968 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a02d86a6-df3f-427a-a317-f053a8353da6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.201508 Aug 08 17:00:42.189223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 536/1067] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:41 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:43.222547 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0333a664-4668-40d4-9716-edf7cb120933 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:43.223186 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0333a664-4668-40d4-9716-edf7cb120933 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:43.230136 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0333a664-4668-40d4-9716-edf7cb120933 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:43.230747 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0333a664-4668-40d4-9716-edf7cb120933 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:43.231187 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0333a664-4668-40d4-9716-edf7cb120933 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:43.231898 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0333a664-4668-40d4-9716-edf7cb120933 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:43.232353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0333a664-4668-40d4-9716-edf7cb120933 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:43.232774 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0333a664-4668-40d4-9716-edf7cb120933 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:43.424090 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0333a664-4668-40d4-9716-edf7cb120933 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:43.434420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0333a664-4668-40d4-9716-edf7cb120933 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:43.436373 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0333a664-4668-40d4-9716-edf7cb120933 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:43.438545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0333a664-4668-40d4-9716-edf7cb120933 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.220113 Aug 08 17:00:43.439511 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 532/1068] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:43 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:00:44.465347 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c9fff0a2-a741-4c4a-a693-615948cd399e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:44.466101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c9fff0a2-a741-4c4a-a693-615948cd399e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:44.476565 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c9fff0a2-a741-4c4a-a693-615948cd399e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:44.477799 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c9fff0a2-a741-4c4a-a693-615948cd399e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:44.480335 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c9fff0a2-a741-4c4a-a693-615948cd399e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:44.480335 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c9fff0a2-a741-4c4a-a693-615948cd399e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:44.481071 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c9fff0a2-a741-4c4a-a693-615948cd399e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:44.481871 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c9fff0a2-a741-4c4a-a693-615948cd399e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:44.737583 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c9fff0a2-a741-4c4a-a693-615948cd399e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:44.752648 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c9fff0a2-a741-4c4a-a693-615948cd399e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:44.755969 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c9fff0a2-a741-4c4a-a693-615948cd399e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:44.758416 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c9fff0a2-a741-4c4a-a693-615948cd399e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.296851 Aug 08 17:00:44.759929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 537/1069] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:44 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:45.801908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7eead402-63ad-47af-bf4f-a152dc7dfef8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:45.802978 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7eead402-63ad-47af-bf4f-a152dc7dfef8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:45.811109 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7eead402-63ad-47af-bf4f-a152dc7dfef8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:45.811631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7eead402-63ad-47af-bf4f-a152dc7dfef8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:45.813946 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7eead402-63ad-47af-bf4f-a152dc7dfef8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:45.814736 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7eead402-63ad-47af-bf4f-a152dc7dfef8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:45.815286 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7eead402-63ad-47af-bf4f-a152dc7dfef8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:45.815716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7eead402-63ad-47af-bf4f-a152dc7dfef8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:45.971509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7eead402-63ad-47af-bf4f-a152dc7dfef8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:45.980641 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7eead402-63ad-47af-bf4f-a152dc7dfef8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:45.982171 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7eead402-63ad-47af-bf4f-a152dc7dfef8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:45.983452 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7eead402-63ad-47af-bf4f-a152dc7dfef8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.187833 Aug 08 17:00:45.984619 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 533/1070] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:45 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:00:46.920060 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-20a35a3a-763f-4944-b3f8-66bf4c7e1437 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:46.920864 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-20a35a3a-763f-4944-b3f8-66bf4c7e1437 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:46.932349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20a35a3a-763f-4944-b3f8-66bf4c7e1437 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:46.933312 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20a35a3a-763f-4944-b3f8-66bf4c7e1437 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:46.934170 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20a35a3a-763f-4944-b3f8-66bf4c7e1437 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:46.935539 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20a35a3a-763f-4944-b3f8-66bf4c7e1437 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:46.936376 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20a35a3a-763f-4944-b3f8-66bf4c7e1437 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:46.937419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20a35a3a-763f-4944-b3f8-66bf4c7e1437 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:46.987495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-20a35a3a-763f-4944-b3f8-66bf4c7e1437 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/ips" status: 200 len: 147 microversion: 2.1 time: 0.070958 Aug 08 17:00:46.997568 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 538/1071] 10.222.0.13 () {58 vars in 1248 bytes} [Mon Aug 8 17:00:46 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/ips => generated 147 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:47.009667 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-db996d25-cb73-4bcb-88ec-03df988b4b87 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:47.010633 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-db996d25-cb73-4bcb-88ec-03df988b4b87 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:47.020775 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-db996d25-cb73-4bcb-88ec-03df988b4b87 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:47.021422 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-db996d25-cb73-4bcb-88ec-03df988b4b87 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:47.022014 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-db996d25-cb73-4bcb-88ec-03df988b4b87 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:47.023088 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-db996d25-cb73-4bcb-88ec-03df988b4b87 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:47.024204 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-db996d25-cb73-4bcb-88ec-03df988b4b87 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:47.024847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-db996d25-cb73-4bcb-88ec-03df988b4b87 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:47.213351 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-db996d25-cb73-4bcb-88ec-03df988b4b87 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:47.229632 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-db996d25-cb73-4bcb-88ec-03df988b4b87 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:47.232646 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-db996d25-cb73-4bcb-88ec-03df988b4b87 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:47.234795 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-db996d25-cb73-4bcb-88ec-03df988b4b87 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.229179 Aug 08 17:00:47.266743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 534/1072] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:47 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:00:48.267780 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-49059e90-35c1-4cff-8f42-7682238eecea tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:48.268544 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-49059e90-35c1-4cff-8f42-7682238eecea tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:48.277479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49059e90-35c1-4cff-8f42-7682238eecea tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:48.278453 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49059e90-35c1-4cff-8f42-7682238eecea tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:48.279224 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49059e90-35c1-4cff-8f42-7682238eecea tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:48.281107 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49059e90-35c1-4cff-8f42-7682238eecea tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:48.282126 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49059e90-35c1-4cff-8f42-7682238eecea tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:48.282883 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-49059e90-35c1-4cff-8f42-7682238eecea tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:48.306256 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:48.440582 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-49059e90-35c1-4cff-8f42-7682238eecea tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:48.449872 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-49059e90-35c1-4cff-8f42-7682238eecea tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:48.451464 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-49059e90-35c1-4cff-8f42-7682238eecea tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:48.453360 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-49059e90-35c1-4cff-8f42-7682238eecea tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.189379 Aug 08 17:00:48.453974 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 539/1073] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:48 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:49.043051 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-24fd629b-e139-4425-97a0-162b94a8a0f3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a3bec21-d101-4e7e-8a12-f130f2f22c6d"}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:49.045699 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-24fd629b-e139-4425-97a0-162b94a8a0f3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:49.053355 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-24fd629b-e139-4425-97a0-162b94a8a0f3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.053980 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-24fd629b-e139-4425-97a0-162b94a8a0f3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.054212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-24fd629b-e139-4425-97a0-162b94a8a0f3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.054930 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-24fd629b-e139-4425-97a0-162b94a8a0f3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.055487 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-24fd629b-e139-4425-97a0-162b94a8a0f3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.057289 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-24fd629b-e139-4425-97a0-162b94a8a0f3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.476466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-26e0ea6e-626b-4412-95c4-a86afbc9a4f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:49.477380 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-26e0ea6e-626b-4412-95c4-a86afbc9a4f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:49.479688 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:49.486766 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-26e0ea6e-626b-4412-95c4-a86afbc9a4f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.487439 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-26e0ea6e-626b-4412-95c4-a86afbc9a4f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.487897 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-26e0ea6e-626b-4412-95c4-a86afbc9a4f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.488615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-26e0ea6e-626b-4412-95c4-a86afbc9a4f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:49.489072 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-26e0ea6e-626b-4412-95c4-a86afbc9a4f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:49.489495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-26e0ea6e-626b-4412-95c4-a86afbc9a4f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:49.679871 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-26e0ea6e-626b-4412-95c4-a86afbc9a4f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:49.689988 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-26e0ea6e-626b-4412-95c4-a86afbc9a4f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:49.693888 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-26e0ea6e-626b-4412-95c4-a86afbc9a4f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:49.693888 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-26e0ea6e-626b-4412-95c4-a86afbc9a4f9 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.220330 Aug 08 17:00:49.693888 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 540/1074] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:49 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:00:49.952212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-24fd629b-e139-4425-97a0-162b94a8a0f3 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "POST /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.913366 Aug 08 17:00:49.959375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 535/1075] 10.222.0.13 () {60 vars in 1323 bytes} [Mon Aug 8 17:00:49 2022] POST /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/os-volume_attachments => generated 194 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:00:50.716500 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f10c5650-db68-4a53-a001-8b5f180728fd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:50.717226 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f10c5650-db68-4a53-a001-8b5f180728fd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:50.725054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f10c5650-db68-4a53-a001-8b5f180728fd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:50.725664 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f10c5650-db68-4a53-a001-8b5f180728fd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:50.726385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f10c5650-db68-4a53-a001-8b5f180728fd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:50.727632 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f10c5650-db68-4a53-a001-8b5f180728fd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:50.728250 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f10c5650-db68-4a53-a001-8b5f180728fd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:50.728825 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f10c5650-db68-4a53-a001-8b5f180728fd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:50.880602 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f10c5650-db68-4a53-a001-8b5f180728fd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:50.888892 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f10c5650-db68-4a53-a001-8b5f180728fd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:50.891007 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f10c5650-db68-4a53-a001-8b5f180728fd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:50.892314 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f10c5650-db68-4a53-a001-8b5f180728fd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.179928 Aug 08 17:00:50.892876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 541/1076] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:50 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:51.918108 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-855cdfd6-6058-434d-bda1-8754b658b281 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:51.918887 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-855cdfd6-6058-434d-bda1-8754b658b281 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:51.926706 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-855cdfd6-6058-434d-bda1-8754b658b281 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:51.927210 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-855cdfd6-6058-434d-bda1-8754b658b281 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:51.927666 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-855cdfd6-6058-434d-bda1-8754b658b281 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:51.928418 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-855cdfd6-6058-434d-bda1-8754b658b281 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:51.928882 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-855cdfd6-6058-434d-bda1-8754b658b281 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:51.929315 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-855cdfd6-6058-434d-bda1-8754b658b281 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:52.096558 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-855cdfd6-6058-434d-bda1-8754b658b281 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:52.098992 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:00:52.106422 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-855cdfd6-6058-434d-bda1-8754b658b281 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:52.113404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-855cdfd6-6058-434d-bda1-8754b658b281 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:52.113404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-855cdfd6-6058-434d-bda1-8754b658b281 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.197368 Aug 08 17:00:52.113404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 536/1077] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:51 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:53.150063 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-850c42bb-a66d-4658-a908-100a709aa31e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:53.151165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-850c42bb-a66d-4658-a908-100a709aa31e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:53.163107 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-850c42bb-a66d-4658-a908-100a709aa31e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:53.163962 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-850c42bb-a66d-4658-a908-100a709aa31e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:53.165062 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-850c42bb-a66d-4658-a908-100a709aa31e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:53.165827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-850c42bb-a66d-4658-a908-100a709aa31e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:53.166431 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-850c42bb-a66d-4658-a908-100a709aa31e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:53.167129 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-850c42bb-a66d-4658-a908-100a709aa31e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:53.357138 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-850c42bb-a66d-4658-a908-100a709aa31e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:53.367301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-850c42bb-a66d-4658-a908-100a709aa31e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:53.368816 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-850c42bb-a66d-4658-a908-100a709aa31e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:53.370033 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-850c42bb-a66d-4658-a908-100a709aa31e tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.225841 Aug 08 17:00:53.370630 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 542/1078] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:53 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:54.399614 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8e479d84-003c-4107-906c-639eccbefa65 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:54.400818 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8e479d84-003c-4107-906c-639eccbefa65 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:54.408473 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e479d84-003c-4107-906c-639eccbefa65 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:54.409207 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e479d84-003c-4107-906c-639eccbefa65 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:54.409721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e479d84-003c-4107-906c-639eccbefa65 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:54.410514 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e479d84-003c-4107-906c-639eccbefa65 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:54.411119 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e479d84-003c-4107-906c-639eccbefa65 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:54.411586 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e479d84-003c-4107-906c-639eccbefa65 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:54.571015 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8e479d84-003c-4107-906c-639eccbefa65 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:54.581226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8e479d84-003c-4107-906c-639eccbefa65 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:54.583659 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8e479d84-003c-4107-906c-639eccbefa65 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:54.585741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8e479d84-003c-4107-906c-639eccbefa65 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1743 microversion: 2.20 time: 0.194491 Aug 08 17:00:54.586732 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 537/1079] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:54 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1743 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:00:55.628737 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0278eae2-6eae-4ee0-a640-dee07ed6f894 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:55.629427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0278eae2-6eae-4ee0-a640-dee07ed6f894 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:55.636753 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0278eae2-6eae-4ee0-a640-dee07ed6f894 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:55.637148 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0278eae2-6eae-4ee0-a640-dee07ed6f894 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:55.637587 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0278eae2-6eae-4ee0-a640-dee07ed6f894 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:55.638301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0278eae2-6eae-4ee0-a640-dee07ed6f894 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:55.638797 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0278eae2-6eae-4ee0-a640-dee07ed6f894 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:55.639223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0278eae2-6eae-4ee0-a640-dee07ed6f894 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:55.825768 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0278eae2-6eae-4ee0-a640-dee07ed6f894 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:55.836276 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0278eae2-6eae-4ee0-a640-dee07ed6f894 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:55.837860 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0278eae2-6eae-4ee0-a640-dee07ed6f894 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:55.839077 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0278eae2-6eae-4ee0-a640-dee07ed6f894 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1743 microversion: 2.20 time: 0.216648 Aug 08 17:00:55.839649 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 543/1080] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:55 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1743 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:56.864445 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c3afb82e-0a0b-4abe-b2e0-01faa6361726 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:56.866454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c3afb82e-0a0b-4abe-b2e0-01faa6361726 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:56.877653 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3afb82e-0a0b-4abe-b2e0-01faa6361726 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:56.878927 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3afb82e-0a0b-4abe-b2e0-01faa6361726 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:56.882722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3afb82e-0a0b-4abe-b2e0-01faa6361726 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:56.882722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3afb82e-0a0b-4abe-b2e0-01faa6361726 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:56.882722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3afb82e-0a0b-4abe-b2e0-01faa6361726 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:56.882722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c3afb82e-0a0b-4abe-b2e0-01faa6361726 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:57.080859 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c3afb82e-0a0b-4abe-b2e0-01faa6361726 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:57.092140 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c3afb82e-0a0b-4abe-b2e0-01faa6361726 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:57.095685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c3afb82e-0a0b-4abe-b2e0-01faa6361726 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:57.097487 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c3afb82e-0a0b-4abe-b2e0-01faa6361726 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1738 microversion: 2.20 time: 0.239180 Aug 08 17:00:57.098370 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 538/1081] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:56 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:00:58.137357 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d66b575a-7db2-44a7-bb17-55081fa4fd29 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:58.140160 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d66b575a-7db2-44a7-bb17-55081fa4fd29 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:58.152082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d66b575a-7db2-44a7-bb17-55081fa4fd29 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:58.152864 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d66b575a-7db2-44a7-bb17-55081fa4fd29 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:58.153534 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d66b575a-7db2-44a7-bb17-55081fa4fd29 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:58.154802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d66b575a-7db2-44a7-bb17-55081fa4fd29 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:58.156166 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d66b575a-7db2-44a7-bb17-55081fa4fd29 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:58.157090 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d66b575a-7db2-44a7-bb17-55081fa4fd29 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:58.410029 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d66b575a-7db2-44a7-bb17-55081fa4fd29 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:58.423544 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d66b575a-7db2-44a7-bb17-55081fa4fd29 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:58.425679 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d66b575a-7db2-44a7-bb17-55081fa4fd29 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:58.433400 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d66b575a-7db2-44a7-bb17-55081fa4fd29 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1738 microversion: 2.20 time: 0.302754 Aug 08 17:00:58.439998 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 544/1082] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:58 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1738 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:00:59.044534 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-871b931a-6d78-4a28-a681-40aec7ef6705 req-47bb8a4b-5840-4624-a5ae-c8b5ae3c9d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37eeb765-0b75-4da4-be22-9fc72927ff6a", "name": "network-vif-plugged", "status": "completed", "tag": "25f9ae20-5161-4130-bc9b-d7c23e20ddc0"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:00:59.056562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-871b931a-6d78-4a28-a681-40aec7ef6705 req-47bb8a4b-5840-4624-a5ae-c8b5ae3c9d7e service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:59.057116 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-871b931a-6d78-4a28-a681-40aec7ef6705 req-47bb8a4b-5840-4624-a5ae-c8b5ae3c9d7e service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:59.057563 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-871b931a-6d78-4a28-a681-40aec7ef6705 req-47bb8a4b-5840-4624-a5ae-c8b5ae3c9d7e service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:59.074602 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-871b931a-6d78-4a28-a681-40aec7ef6705 req-47bb8a4b-5840-4624-a5ae-c8b5ae3c9d7e service nova] Creating event network-vif-plugged:25f9ae20-5161-4130-bc9b-d7c23e20ddc0 for instance 37eeb765-0b75-4da4-be22-9fc72927ff6a on hv-cinder-85220 Aug 08 17:00:59.085374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-871b931a-6d78-4a28-a681-40aec7ef6705 req-47bb8a4b-5840-4624-a5ae-c8b5ae3c9d7e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044991 Aug 08 17:00:59.086078 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 539/1083] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:00:59.453894 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-106fb069-467e-474f-981c-19d2cdedc44a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:00:59.454768 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-106fb069-467e-474f-981c-19d2cdedc44a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:00:59.469144 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-106fb069-467e-474f-981c-19d2cdedc44a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:59.476354 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-106fb069-467e-474f-981c-19d2cdedc44a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:59.476354 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-106fb069-467e-474f-981c-19d2cdedc44a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:59.476354 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-106fb069-467e-474f-981c-19d2cdedc44a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:00:59.476354 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-106fb069-467e-474f-981c-19d2cdedc44a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:00:59.477102 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-106fb069-467e-474f-981c-19d2cdedc44a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:00:59.838719 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-106fb069-467e-474f-981c-19d2cdedc44a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:59.862444 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-106fb069-467e-474f-981c-19d2cdedc44a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:59.866088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-106fb069-467e-474f-981c-19d2cdedc44a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:00:59.867863 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-106fb069-467e-474f-981c-19d2cdedc44a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1738 microversion: 2.20 time: 0.418153 Aug 08 17:00:59.869021 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 545/1084] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:00:59 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1738 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:01:00.894604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8db18d7d-06a1-4d1e-9895-56a4c82ec3fb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:00.900558 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8db18d7d-06a1-4d1e-9895-56a4c82ec3fb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:00.925347 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8db18d7d-06a1-4d1e-9895-56a4c82ec3fb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:00.930049 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8db18d7d-06a1-4d1e-9895-56a4c82ec3fb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:00.931030 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8db18d7d-06a1-4d1e-9895-56a4c82ec3fb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:00.935062 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8db18d7d-06a1-4d1e-9895-56a4c82ec3fb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:00.935062 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8db18d7d-06a1-4d1e-9895-56a4c82ec3fb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:00.935062 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8db18d7d-06a1-4d1e-9895-56a4c82ec3fb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:01.234166 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8db18d7d-06a1-4d1e-9895-56a4c82ec3fb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:01.247288 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8db18d7d-06a1-4d1e-9895-56a4c82ec3fb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:01.250247 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8db18d7d-06a1-4d1e-9895-56a4c82ec3fb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:01.251823 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8db18d7d-06a1-4d1e-9895-56a4c82ec3fb tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1738 microversion: 2.20 time: 0.363438 Aug 08 17:01:01.252734 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 540/1085] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:00 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:01.468444 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d75e5251-1c90-4f4d-adc3-7e6595813b2f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:01.469101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d75e5251-1c90-4f4d-adc3-7e6595813b2f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:01.489425 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d75e5251-1c90-4f4d-adc3-7e6595813b2f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:01.493047 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d75e5251-1c90-4f4d-adc3-7e6595813b2f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:01.497969 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d75e5251-1c90-4f4d-adc3-7e6595813b2f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:01.500983 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d75e5251-1c90-4f4d-adc3-7e6595813b2f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:01.502203 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d75e5251-1c90-4f4d-adc3-7e6595813b2f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:01.503307 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d75e5251-1c90-4f4d-adc3-7e6595813b2f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:01.895156 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-d75e5251-1c90-4f4d-adc3-7e6595813b2f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lazy-loading 'services' on Instance uuid 54deb65a-9be6-4c56-921e-b4ce8d6102c0 {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:01:02.284148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-44b078f0-1309-41b2-a91b-6f5b4c9858d8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:02.288290 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-44b078f0-1309-41b2-a91b-6f5b4c9858d8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:02.295360 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44b078f0-1309-41b2-a91b-6f5b4c9858d8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:02.297273 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44b078f0-1309-41b2-a91b-6f5b4c9858d8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:02.298290 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44b078f0-1309-41b2-a91b-6f5b4c9858d8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:02.300808 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44b078f0-1309-41b2-a91b-6f5b4c9858d8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:02.302006 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44b078f0-1309-41b2-a91b-6f5b4c9858d8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:02.303075 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44b078f0-1309-41b2-a91b-6f5b4c9858d8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:02.319890 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d75e5251-1c90-4f4d-adc3-7e6595813b2f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/os-volume_attachments/2a3bec21-d101-4e7e-8a12-f130f2f22c6d" status: 202 len: 0 microversion: 2.1 time: 0.863658 Aug 08 17:01:02.341114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 546/1086] 10.222.0.13 () {58 vars in 1416 bytes} [Mon Aug 8 17:01:01 2022] DELETE /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/os-volume_attachments/2a3bec21-d101-4e7e-8a12-f130f2f22c6d => generated 0 bytes in 887 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:01:02.363079 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-263bdde5-b155-4231-9fc1-9d9d9d985f3b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:02.369275 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-263bdde5-b155-4231-9fc1-9d9d9d985f3b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:02.382019 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-263bdde5-b155-4231-9fc1-9d9d9d985f3b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:02.386540 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-263bdde5-b155-4231-9fc1-9d9d9d985f3b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:02.387950 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-263bdde5-b155-4231-9fc1-9d9d9d985f3b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:02.389805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-263bdde5-b155-4231-9fc1-9d9d9d985f3b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:02.390854 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-263bdde5-b155-4231-9fc1-9d9d9d985f3b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:02.392293 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-263bdde5-b155-4231-9fc1-9d9d9d985f3b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:02.479868 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-263bdde5-b155-4231-9fc1-9d9d9d985f3b tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129444 Aug 08 17:01:02.483408 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 547/1087] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 17:01:02 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:01:02.856399 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-44b078f0-1309-41b2-a91b-6f5b4c9858d8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:02.868607 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-44b078f0-1309-41b2-a91b-6f5b4c9858d8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:02.870677 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-44b078f0-1309-41b2-a91b-6f5b4c9858d8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:02.872321 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-44b078f0-1309-41b2-a91b-6f5b4c9858d8 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1738 microversion: 2.20 time: 0.598739 Aug 08 17:01:02.888015 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 541/1088] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:02 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1738 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:01:03.497101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5c382269-e2d6-4752-aa15-649ecdbb647f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:03.502691 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5c382269-e2d6-4752-aa15-649ecdbb647f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:03.535618 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5c382269-e2d6-4752-aa15-649ecdbb647f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:03.537178 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5c382269-e2d6-4752-aa15-649ecdbb647f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:03.539131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5c382269-e2d6-4752-aa15-649ecdbb647f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:03.541906 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5c382269-e2d6-4752-aa15-649ecdbb647f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:03.544834 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5c382269-e2d6-4752-aa15-649ecdbb647f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:03.546060 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5c382269-e2d6-4752-aa15-649ecdbb647f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:03.601982 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5c382269-e2d6-4752-aa15-649ecdbb647f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109263 Aug 08 17:01:03.607626 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 548/1089] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 17:01:03 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:01:03.902639 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1f53ba73-b076-4765-b393-fa8795c45bfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:03.904631 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1f53ba73-b076-4765-b393-fa8795c45bfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:03.942455 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1f53ba73-b076-4765-b393-fa8795c45bfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:03.944790 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1f53ba73-b076-4765-b393-fa8795c45bfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:03.946490 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1f53ba73-b076-4765-b393-fa8795c45bfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:03.950471 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1f53ba73-b076-4765-b393-fa8795c45bfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:03.952494 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1f53ba73-b076-4765-b393-fa8795c45bfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:03.953122 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1f53ba73-b076-4765-b393-fa8795c45bfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:04.323835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1f53ba73-b076-4765-b393-fa8795c45bfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:04.350591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1f53ba73-b076-4765-b393-fa8795c45bfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:04.353388 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1f53ba73-b076-4765-b393-fa8795c45bfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:04.354667 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1f53ba73-b076-4765-b393-fa8795c45bfe tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1738 microversion: 2.20 time: 0.457151 Aug 08 17:01:04.355629 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 542/1090] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:03 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1738 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:01:04.618142 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d06a328d-6c0d-49cd-b4d5-932d06ed4b64 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:04.621230 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d06a328d-6c0d-49cd-b4d5-932d06ed4b64 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:04.631192 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d06a328d-6c0d-49cd-b4d5-932d06ed4b64 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:04.632018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d06a328d-6c0d-49cd-b4d5-932d06ed4b64 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:04.633992 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d06a328d-6c0d-49cd-b4d5-932d06ed4b64 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:04.636250 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d06a328d-6c0d-49cd-b4d5-932d06ed4b64 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:04.637419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d06a328d-6c0d-49cd-b4d5-932d06ed4b64 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:04.638088 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d06a328d-6c0d-49cd-b4d5-932d06ed4b64 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:04.676020 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d06a328d-6c0d-49cd-b4d5-932d06ed4b64 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062488 Aug 08 17:01:04.688672 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 549/1091] 10.222.0.13 () {58 vars in 1302 bytes} [Mon Aug 8 17:01:04 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 17:01:04.784236 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fccd436b-112b-4d99-b09e-f3f48130d826 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:04.785026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fccd436b-112b-4d99-b09e-f3f48130d826 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:04.793316 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fccd436b-112b-4d99-b09e-f3f48130d826 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:04.794187 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fccd436b-112b-4d99-b09e-f3f48130d826 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:04.794897 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fccd436b-112b-4d99-b09e-f3f48130d826 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:04.796016 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fccd436b-112b-4d99-b09e-f3f48130d826 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:04.796740 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fccd436b-112b-4d99-b09e-f3f48130d826 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:04.797396 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fccd436b-112b-4d99-b09e-f3f48130d826 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:04.843697 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fccd436b-112b-4d99-b09e-f3f48130d826 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Going to try to terminate instance {{(pid=130235) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:01:05.292428 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fccd436b-112b-4d99-b09e-f3f48130d826 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 204 len: 0 microversion: 2.1 time: 0.511635 Aug 08 17:01:05.310449 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 543/1092] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:01:04 2022] DELETE /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:01:05.315607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-78c0787b-53a0-4cba-9044-7668f25ecf6f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:05.317709 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-78c0787b-53a0-4cba-9044-7668f25ecf6f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:05.331970 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78c0787b-53a0-4cba-9044-7668f25ecf6f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:05.332989 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78c0787b-53a0-4cba-9044-7668f25ecf6f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:05.333897 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78c0787b-53a0-4cba-9044-7668f25ecf6f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:05.335733 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78c0787b-53a0-4cba-9044-7668f25ecf6f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:05.336968 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78c0787b-53a0-4cba-9044-7668f25ecf6f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:05.338287 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78c0787b-53a0-4cba-9044-7668f25ecf6f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:05.386997 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-979393a2-40c8-4427-8cf7-d0d5ed8ebfe0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:05.390820 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-979393a2-40c8-4427-8cf7-d0d5ed8ebfe0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:05.417268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-979393a2-40c8-4427-8cf7-d0d5ed8ebfe0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:05.418307 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-979393a2-40c8-4427-8cf7-d0d5ed8ebfe0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:05.421505 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-979393a2-40c8-4427-8cf7-d0d5ed8ebfe0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:05.425982 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-979393a2-40c8-4427-8cf7-d0d5ed8ebfe0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:05.427316 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-979393a2-40c8-4427-8cf7-d0d5ed8ebfe0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:05.431037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-979393a2-40c8-4427-8cf7-d0d5ed8ebfe0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:05.646882 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-78c0787b-53a0-4cba-9044-7668f25ecf6f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:05.677237 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-78c0787b-53a0-4cba-9044-7668f25ecf6f tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1680 microversion: 2.1 time: 0.369129 Aug 08 17:01:05.681368 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 550/1093] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:05 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1680 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:05.722155 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-979393a2-40c8-4427-8cf7-d0d5ed8ebfe0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:05.732416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-979393a2-40c8-4427-8cf7-d0d5ed8ebfe0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:05.735066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-979393a2-40c8-4427-8cf7-d0d5ed8ebfe0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:05.735066 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-979393a2-40c8-4427-8cf7-d0d5ed8ebfe0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1738 microversion: 2.20 time: 0.360577 Aug 08 17:01:05.736663 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 544/1094] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:05 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1738 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:06.705167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-52aa56b5-1b9b-4e31-9fab-7caf37283571 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:06.706018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-52aa56b5-1b9b-4e31-9fab-7caf37283571 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:06.762778 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4fddfeea-f945-41bd-8a3f-cb78616ec759 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:06.763473 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4fddfeea-f945-41bd-8a3f-cb78616ec759 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:06.856303 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52aa56b5-1b9b-4e31-9fab-7caf37283571 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:06.856863 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52aa56b5-1b9b-4e31-9fab-7caf37283571 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:06.857327 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52aa56b5-1b9b-4e31-9fab-7caf37283571 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:06.857442 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4fddfeea-f945-41bd-8a3f-cb78616ec759 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:06.857884 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4fddfeea-f945-41bd-8a3f-cb78616ec759 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:06.859079 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52aa56b5-1b9b-4e31-9fab-7caf37283571 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:06.859372 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52aa56b5-1b9b-4e31-9fab-7caf37283571 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:06.864775 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52aa56b5-1b9b-4e31-9fab-7caf37283571 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:06.864989 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4fddfeea-f945-41bd-8a3f-cb78616ec759 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:06.864989 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4fddfeea-f945-41bd-8a3f-cb78616ec759 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:06.864989 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4fddfeea-f945-41bd-8a3f-cb78616ec759 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:06.864989 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4fddfeea-f945-41bd-8a3f-cb78616ec759 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:07.142093 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-52aa56b5-1b9b-4e31-9fab-7caf37283571 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:07.157182 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-52aa56b5-1b9b-4e31-9fab-7caf37283571 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1680 microversion: 2.1 time: 0.456793 Aug 08 17:01:07.158390 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 551/1095] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:06 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1680 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:07.291818 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4fddfeea-f945-41bd-8a3f-cb78616ec759 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:07.301917 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4fddfeea-f945-41bd-8a3f-cb78616ec759 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:07.304394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4fddfeea-f945-41bd-8a3f-cb78616ec759 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:07.310931 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4fddfeea-f945-41bd-8a3f-cb78616ec759 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1738 microversion: 2.20 time: 0.547930 Aug 08 17:01:07.310931 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 545/1096] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:06 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1738 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:01:08.198105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-73eaeb43-5368-41d2-8e61-de161600ca52 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:08.199545 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-73eaeb43-5368-41d2-8e61-de161600ca52 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:08.210089 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73eaeb43-5368-41d2-8e61-de161600ca52 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:08.211336 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73eaeb43-5368-41d2-8e61-de161600ca52 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:08.212888 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73eaeb43-5368-41d2-8e61-de161600ca52 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:08.213958 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73eaeb43-5368-41d2-8e61-de161600ca52 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:08.214506 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73eaeb43-5368-41d2-8e61-de161600ca52 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:08.215214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-73eaeb43-5368-41d2-8e61-de161600ca52 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:08.350845 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fd5f10ed-0067-43dc-8f5d-844bfb969614 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:08.350845 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fd5f10ed-0067-43dc-8f5d-844bfb969614 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:08.350845 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:08.355477 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-73eaeb43-5368-41d2-8e61-de161600ca52 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:08.366485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd5f10ed-0067-43dc-8f5d-844bfb969614 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:08.375698 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd5f10ed-0067-43dc-8f5d-844bfb969614 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:08.376446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd5f10ed-0067-43dc-8f5d-844bfb969614 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:08.377789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd5f10ed-0067-43dc-8f5d-844bfb969614 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:08.378616 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd5f10ed-0067-43dc-8f5d-844bfb969614 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:08.379389 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fd5f10ed-0067-43dc-8f5d-844bfb969614 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:08.382786 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-73eaeb43-5368-41d2-8e61-de161600ca52 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1612 microversion: 2.1 time: 0.183390 Aug 08 17:01:08.384174 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 552/1097] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:08 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1612 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:08.652932 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fd5f10ed-0067-43dc-8f5d-844bfb969614 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:08.668211 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fd5f10ed-0067-43dc-8f5d-844bfb969614 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:08.674798 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fd5f10ed-0067-43dc-8f5d-844bfb969614 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:08.677426 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fd5f10ed-0067-43dc-8f5d-844bfb969614 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1738 microversion: 2.20 time: 0.349234 Aug 08 17:01:08.699349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 546/1098] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:08 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1738 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:09.040116 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-1d306fb6-0d41-4567-ab40-3b3ab4c4d6b1 req-5ece54f1-9284-466e-88a1-febfc7658796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54deb65a-9be6-4c56-921e-b4ce8d6102c0", "name": "network-vif-deleted", "tag": "43c96a20-b7b5-40d0-ac3b-42931066c51c"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:09.055579 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-1d306fb6-0d41-4567-ab40-3b3ab4c4d6b1 req-5ece54f1-9284-466e-88a1-febfc7658796 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:09.056597 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-1d306fb6-0d41-4567-ab40-3b3ab4c4d6b1 req-5ece54f1-9284-466e-88a1-febfc7658796 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:09.057494 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-1d306fb6-0d41-4567-ab40-3b3ab4c4d6b1 req-5ece54f1-9284-466e-88a1-febfc7658796 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:09.072647 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-1d306fb6-0d41-4567-ab40-3b3ab4c4d6b1 req-5ece54f1-9284-466e-88a1-febfc7658796 service nova] Creating event network-vif-deleted:43c96a20-b7b5-40d0-ac3b-42931066c51c for instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 on hv-cinder-85220 Aug 08 17:01:09.078770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-1d306fb6-0d41-4567-ab40-3b3ab4c4d6b1 req-5ece54f1-9284-466e-88a1-febfc7658796 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043140 Aug 08 17:01:09.097792 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 553/1099] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:01:09.424089 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:09.424789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:09.445318 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:09.446082 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:09.446781 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:09.448857 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:09.451222 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:09.451945 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:09.535356 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:09.536185 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:09.536990 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:09.537686 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lazy-loading 'fault' on Instance uuid 54deb65a-9be6-4c56-921e-b4ce8d6102c0 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:01:09.628928 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:09.643235 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4307f76e-da07-4537-ab66-4a6e58f3ee87 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1332 microversion: 2.1 time: 0.223706 Aug 08 17:01:09.644401 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 547/1100] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:09 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1332 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:09.706113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3e85ecbe-46e2-49f6-84a8-23603e35b2a3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:09.707012 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3e85ecbe-46e2-49f6-84a8-23603e35b2a3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:09.714019 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3e85ecbe-46e2-49f6-84a8-23603e35b2a3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:09.714856 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3e85ecbe-46e2-49f6-84a8-23603e35b2a3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:09.715468 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3e85ecbe-46e2-49f6-84a8-23603e35b2a3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:09.716433 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3e85ecbe-46e2-49f6-84a8-23603e35b2a3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:09.717107 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3e85ecbe-46e2-49f6-84a8-23603e35b2a3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:09.718284 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3e85ecbe-46e2-49f6-84a8-23603e35b2a3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:09.894432 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3e85ecbe-46e2-49f6-84a8-23603e35b2a3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:09.904340 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3e85ecbe-46e2-49f6-84a8-23603e35b2a3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:09.906969 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3e85ecbe-46e2-49f6-84a8-23603e35b2a3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:09.908726 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3e85ecbe-46e2-49f6-84a8-23603e35b2a3 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1738 microversion: 2.20 time: 0.208378 Aug 08 17:01:09.909509 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 554/1101] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:09 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:01:10.677334 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:10.677906 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:10.685014 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:10.685501 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:10.685986 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:10.686987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:10.687598 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:10.688226 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:10.727578 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:10.730717 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:10.730717 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:10.730717 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lazy-loading 'fault' on Instance uuid 54deb65a-9be6-4c56-921e-b4ce8d6102c0 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:01:10.785686 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:10.794485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-de06a9a0-3725-4288-bff3-e199175aabd1 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1332 microversion: 2.1 time: 0.121181 Aug 08 17:01:10.796585 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 548/1102] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:10 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1332 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:10.942375 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-bcec0865-b761-40f6-a716-d944a3295b7c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:10.943055 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-bcec0865-b761-40f6-a716-d944a3295b7c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:10.950222 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bcec0865-b761-40f6-a716-d944a3295b7c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:10.950747 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bcec0865-b761-40f6-a716-d944a3295b7c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:10.951195 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bcec0865-b761-40f6-a716-d944a3295b7c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:10.952762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bcec0865-b761-40f6-a716-d944a3295b7c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:10.953508 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bcec0865-b761-40f6-a716-d944a3295b7c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:10.954016 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bcec0865-b761-40f6-a716-d944a3295b7c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:11.108725 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bcec0865-b761-40f6-a716-d944a3295b7c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:11.117431 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bcec0865-b761-40f6-a716-d944a3295b7c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:11.118982 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bcec0865-b761-40f6-a716-d944a3295b7c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:11.120204 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-bcec0865-b761-40f6-a716-d944a3295b7c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1738 microversion: 2.20 time: 0.184303 Aug 08 17:01:11.120776 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 555/1103] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:10 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:11.839038 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:11.840119 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:11.849331 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:11.849834 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:11.850348 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:11.851186 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:11.851723 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:11.852303 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:11.895864 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:11.896469 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:11.896980 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:11.897509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lazy-loading 'fault' on Instance uuid 54deb65a-9be6-4c56-921e-b4ce8d6102c0 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:01:11.967625 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb16e7edbe143e9b96325842896f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2063a114c1942cab80ae4b708be9ab2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:11.986809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-43bb4fce-ed9c-4e01-99af-ff92bdd48197 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 200 len: 1332 microversion: 2.1 time: 0.156690 Aug 08 17:01:11.988147 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 549/1104] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:11 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 1332 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:12.146248 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9fc69b45-6e36-4ed7-b7a2-9a5c68bbdf92 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:12.147260 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9fc69b45-6e36-4ed7-b7a2-9a5c68bbdf92 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:12.155450 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9fc69b45-6e36-4ed7-b7a2-9a5c68bbdf92 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:12.156019 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9fc69b45-6e36-4ed7-b7a2-9a5c68bbdf92 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:12.156370 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9fc69b45-6e36-4ed7-b7a2-9a5c68bbdf92 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:12.157167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9fc69b45-6e36-4ed7-b7a2-9a5c68bbdf92 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:12.157639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9fc69b45-6e36-4ed7-b7a2-9a5c68bbdf92 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:12.158086 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9fc69b45-6e36-4ed7-b7a2-9a5c68bbdf92 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:12.163151 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:12.327369 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9fc69b45-6e36-4ed7-b7a2-9a5c68bbdf92 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:12.339290 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9fc69b45-6e36-4ed7-b7a2-9a5c68bbdf92 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:12.341446 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9fc69b45-6e36-4ed7-b7a2-9a5c68bbdf92 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:12.343543 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9fc69b45-6e36-4ed7-b7a2-9a5c68bbdf92 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1738 microversion: 2.20 time: 0.203076 Aug 08 17:01:12.346836 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 556/1105] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:12 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:01:13.042758 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ff2f51a9-ce43-4a8c-8994-76d6f32297ea tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:13.043387 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ff2f51a9-ce43-4a8c-8994-76d6f32297ea tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:13.053667 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff2f51a9-ce43-4a8c-8994-76d6f32297ea tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:13.054189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff2f51a9-ce43-4a8c-8994-76d6f32297ea tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:13.058298 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff2f51a9-ce43-4a8c-8994-76d6f32297ea tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:13.058298 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff2f51a9-ce43-4a8c-8994-76d6f32297ea tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:13.058298 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff2f51a9-ce43-4a8c-8994-76d6f32297ea tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:13.058298 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ff2f51a9-ce43-4a8c-8994-76d6f32297ea tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:13.071716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-ff2f51a9-ce43-4a8c-8994-76d6f32297ea tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ff2f51a9-ce43-4a8c-8994-76d6f32297ea tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 HTTP/1.1 Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:01:13.073410 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:01:13.075816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:01:13.075816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:13.075816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:13.075816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:13.075816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:13.075816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:01:13.075816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:01:13.075816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 17:01:13.075816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:13.075816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:01:13.075816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:13.075816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '54deb65a-9be6-4c56-921e-b4ce8d6102c0'} Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:01:13.077371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:13.081073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:13.084059 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ff2f51a9-ce43-4a8c-8994-76d6f32297ea tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 404 to user: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:01:13.084059 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ff2f51a9-ce43-4a8c-8994-76d6f32297ea tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 404 len: 111 microversion: 2.1 time: 0.036385 Aug 08 17:01:13.084059 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 550/1106] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:13 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:01:13.085073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-323e4c95-268a-4d41-af03-92a5fe5d0f0c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '.version_select at 0x7f501610de50>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:13.200351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-323e4c95-268a-4d41-af03-92a5fe5d0f0c tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707161265" status: 202 len: 0 microversion: 2.1 time: 0.120015 Aug 08 17:01:13.201009 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 557/1107] 10.222.0.13 () {58 vars in 1221 bytes} [Mon Aug 8 17:01:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707161265 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:01:13.367511 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-95186f36-5464-4abd-8fa8-af04ec820c6c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:13.367511 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-95186f36-5464-4abd-8fa8-af04ec820c6c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:13.375242 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-95186f36-5464-4abd-8fa8-af04ec820c6c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:13.375242 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-95186f36-5464-4abd-8fa8-af04ec820c6c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:13.375739 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-95186f36-5464-4abd-8fa8-af04ec820c6c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:13.376214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-95186f36-5464-4abd-8fa8-af04ec820c6c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:13.376667 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-95186f36-5464-4abd-8fa8-af04ec820c6c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:13.377083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-95186f36-5464-4abd-8fa8-af04ec820c6c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:13.609228 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-95186f36-5464-4abd-8fa8-af04ec820c6c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:13.626919 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-95186f36-5464-4abd-8fa8-af04ec820c6c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:13.629371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-95186f36-5464-4abd-8fa8-af04ec820c6c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:13.630955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-95186f36-5464-4abd-8fa8-af04ec820c6c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1738 microversion: 2.20 time: 0.267427 Aug 08 17:01:13.631697 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 551/1108] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:13 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:14.655546 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f717b8d9-e276-476e-8fd0-91959fc34e83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:14.656378 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f717b8d9-e276-476e-8fd0-91959fc34e83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:14.664147 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f717b8d9-e276-476e-8fd0-91959fc34e83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:14.664728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f717b8d9-e276-476e-8fd0-91959fc34e83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:14.665073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f717b8d9-e276-476e-8fd0-91959fc34e83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:14.665779 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f717b8d9-e276-476e-8fd0-91959fc34e83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:14.666266 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f717b8d9-e276-476e-8fd0-91959fc34e83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:14.667072 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f717b8d9-e276-476e-8fd0-91959fc34e83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:14.856058 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f717b8d9-e276-476e-8fd0-91959fc34e83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:14.865526 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f717b8d9-e276-476e-8fd0-91959fc34e83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:14.867058 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f717b8d9-e276-476e-8fd0-91959fc34e83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:14.868240 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f717b8d9-e276-476e-8fd0-91959fc34e83 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1720 microversion: 2.20 time: 0.216787 Aug 08 17:01:14.868790 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 558/1109] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:14 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:15.730388 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-018bacd4-0631-4e57-9b0e-8e4730614654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:15.731346 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-018bacd4-0631-4e57-9b0e-8e4730614654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:15.738412 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-018bacd4-0631-4e57-9b0e-8e4730614654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:15.738959 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-018bacd4-0631-4e57-9b0e-8e4730614654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:15.739536 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-018bacd4-0631-4e57-9b0e-8e4730614654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:15.740287 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-018bacd4-0631-4e57-9b0e-8e4730614654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:15.740803 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-018bacd4-0631-4e57-9b0e-8e4730614654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:15.741231 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-018bacd4-0631-4e57-9b0e-8e4730614654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:15.745963 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:15.756679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-018bacd4-0631-4e57-9b0e-8e4730614654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-018bacd4-0631-4e57-9b0e-8e4730614654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: DELETE /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 HTTP/1.1 Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:01:15.758267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:01:15.760891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:01:15.760891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:15.760891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:15.760891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:15.760891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:15.760891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:01:15.760891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:01:15.760891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 17:01:15.760891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:15.760891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:01:15.760891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:15.760891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '54deb65a-9be6-4c56-921e-b4ce8d6102c0'} Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:01:15.762397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:15.766789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:15.771833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-018bacd4-0631-4e57-9b0e-8e4730614654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 404 to user: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:01:15.771833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-018bacd4-0631-4e57-9b0e-8e4730614654 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 404 len: 111 microversion: 2.1 time: 0.033687 Aug 08 17:01:15.771833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 552/1110] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:01:15 2022] DELETE /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:01:15.772565 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4cddecbf-4137-46c7-8da1-58d76e64b904 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:15.772565 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4cddecbf-4137-46c7-8da1-58d76e64b904 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 54deb65a-9be6-4c56-921e-b4ce8d6102c0] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:15.778101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4cddecbf-4137-46c7-8da1-58d76e64b904 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:15.778674 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4cddecbf-4137-46c7-8da1-58d76e64b904 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:15.779346 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4cddecbf-4137-46c7-8da1-58d76e64b904 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:15.780999 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4cddecbf-4137-46c7-8da1-58d76e64b904 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:15.781466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4cddecbf-4137-46c7-8da1-58d76e64b904 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:15.781902 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4cddecbf-4137-46c7-8da1-58d76e64b904 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:15.799476 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-4cddecbf-4137-46c7-8da1-58d76e64b904 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4cddecbf-4137-46c7-8da1-58d76e64b904 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 HTTP/1.1 Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 17:01:15.801319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 17:01:15.802749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:01:15.802749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:15.802749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:15.802749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:15.802749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:15.802749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 17:01:15.802749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 17:01:15.802749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 17:01:15.802749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:15.802749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 17:01:15.802749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:15.802749 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': '54deb65a-9be6-4c56-921e-b4ce8d6102c0'} Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:01:15.805757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. Aug 08 17:01:15.809342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:15.812809 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4cddecbf-4137-46c7-8da1-58d76e64b904 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 404 to user: Instance 54deb65a-9be6-4c56-921e-b4ce8d6102c0 could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:01:15.812809 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4cddecbf-4137-46c7-8da1-58d76e64b904 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0" status: 404 len: 111 microversion: 2.1 time: 0.037323 Aug 08 17:01:15.812809 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 559/1111] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:15 2022] GET /compute/v2.1/servers/54deb65a-9be6-4c56-921e-b4ce8d6102c0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:01:15.896992 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-cd74cf54-55ec-4874-ad91-997459d32944 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:15.897732 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-cd74cf54-55ec-4874-ad91-997459d32944 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:15.905353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cd74cf54-55ec-4874-ad91-997459d32944 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:15.905353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cd74cf54-55ec-4874-ad91-997459d32944 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:15.905678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cd74cf54-55ec-4874-ad91-997459d32944 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:15.906398 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cd74cf54-55ec-4874-ad91-997459d32944 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:15.906883 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cd74cf54-55ec-4874-ad91-997459d32944 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:15.907309 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-cd74cf54-55ec-4874-ad91-997459d32944 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:16.087789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-cd74cf54-55ec-4874-ad91-997459d32944 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:16.106324 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-cd74cf54-55ec-4874-ad91-997459d32944 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:16.112695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-cd74cf54-55ec-4874-ad91-997459d32944 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:16.128733 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-cd74cf54-55ec-4874-ad91-997459d32944 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1720 microversion: 2.20 time: 0.235487 Aug 08 17:01:16.143955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 553/1112] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:15 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1720 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:17.167567 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-235fc70a-c9a0-4a5e-8c43-f80b0dd2f81c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:17.168982 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-235fc70a-c9a0-4a5e-8c43-f80b0dd2f81c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:17.184120 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-235fc70a-c9a0-4a5e-8c43-f80b0dd2f81c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.184120 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-235fc70a-c9a0-4a5e-8c43-f80b0dd2f81c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.184120 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-235fc70a-c9a0-4a5e-8c43-f80b0dd2f81c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.184120 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-235fc70a-c9a0-4a5e-8c43-f80b0dd2f81c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.184769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-235fc70a-c9a0-4a5e-8c43-f80b0dd2f81c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.184769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-235fc70a-c9a0-4a5e-8c43-f80b0dd2f81c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.189770 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-135ab128-b9ff-4ac0-9756-f53046264ed0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:17.190618 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-135ab128-b9ff-4ac0-9756-f53046264ed0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:17.200269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-135ab128-b9ff-4ac0-9756-f53046264ed0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.206434 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-135ab128-b9ff-4ac0-9756-f53046264ed0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.206659 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-135ab128-b9ff-4ac0-9756-f53046264ed0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.208653 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-135ab128-b9ff-4ac0-9756-f53046264ed0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.208653 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-135ab128-b9ff-4ac0-9756-f53046264ed0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.209122 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-135ab128-b9ff-4ac0-9756-f53046264ed0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.236071 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-135ab128-b9ff-4ac0-9756-f53046264ed0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-135ab128-b9ff-4ac0-9756-f53046264ed0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: DELETE /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 HTTP/1.1 Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:01:17.238643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:01:17.240092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:01:17.240092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:17.240092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:17.240092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:17.240092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:17.240092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:01:17.240092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:01:17.240092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 17:01:17.240092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:17.240092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:01:17.240092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 17:01:17.240092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'd228b747-dc71-4145-bc09-820362dc7fc3'} Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:01:17.241083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 17:01:17.242362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.244005 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-135ab128-b9ff-4ac0-9756-f53046264ed0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 404 to user: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:01:17.244005 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-135ab128-b9ff-4ac0-9756-f53046264ed0 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 404 len: 111 microversion: 2.1 time: 0.055013 Aug 08 17:01:17.244005 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 554/1113] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:01:17 2022] DELETE /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:01:17.250830 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f3db5cc4-6874-4095-b03f-5ee5504d57a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:17.251459 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f3db5cc4-6874-4095-b03f-5ee5504d57a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: d228b747-dc71-4145-bc09-820362dc7fc3] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:17.258155 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f3db5cc4-6874-4095-b03f-5ee5504d57a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.258659 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f3db5cc4-6874-4095-b03f-5ee5504d57a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.259102 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f3db5cc4-6874-4095-b03f-5ee5504d57a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.259819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f3db5cc4-6874-4095-b03f-5ee5504d57a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.260282 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f3db5cc4-6874-4095-b03f-5ee5504d57a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.260697 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f3db5cc4-6874-4095-b03f-5ee5504d57a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.276669 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-f3db5cc4-6874-4095-b03f-5ee5504d57a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f3db5cc4-6874-4095-b03f-5ee5504d57a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 HTTP/1.1 Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:01:17.278189 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:01:17.281157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:01:17.281157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:17.281157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:17.281157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:17.281157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:17.281157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:01:17.281157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:01:17.281157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 17:01:17.281157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:17.281157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:01:17.281157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 17:01:17.281157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'd228b747-dc71-4145-bc09-820362dc7fc3'} Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:01:17.281964 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. Aug 08 17:01:17.283268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.284379 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f3db5cc4-6874-4095-b03f-5ee5504d57a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 404 to user: Instance d228b747-dc71-4145-bc09-820362dc7fc3 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:01:17.284379 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f3db5cc4-6874-4095-b03f-5ee5504d57a2 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3" status: 404 len: 111 microversion: 2.1 time: 0.035615 Aug 08 17:01:17.284379 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 555/1114] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:17 2022] GET /compute/v2.1/servers/d228b747-dc71-4145-bc09-820362dc7fc3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:01:17.294589 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2ecae630-2f6b-4335-9ec7-ba9aba895c7e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:17.295427 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2ecae630-2f6b-4335-9ec7-ba9aba895c7e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:17.302817 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2ecae630-2f6b-4335-9ec7-ba9aba895c7e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.303342 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2ecae630-2f6b-4335-9ec7-ba9aba895c7e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.304219 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2ecae630-2f6b-4335-9ec7-ba9aba895c7e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.305306 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2ecae630-2f6b-4335-9ec7-ba9aba895c7e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.305798 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2ecae630-2f6b-4335-9ec7-ba9aba895c7e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.306252 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2ecae630-2f6b-4335-9ec7-ba9aba895c7e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.323239 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-2ecae630-2f6b-4335-9ec7-ba9aba895c7e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2ecae630-2f6b-4335-9ec7-ba9aba895c7e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: DELETE /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 HTTP/1.1 Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:01:17.324995 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:01:17.327444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:01:17.327444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:17.327444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:17.327444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:17.327444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:17.327444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:01:17.327444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:01:17.327444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 17:01:17.327444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:17.327444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:01:17.327444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 17:01:17.327444 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '8cfbc416-d601-45f7-82e8-a6d09c30f448'} Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:01:17.328454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 17:01:17.329700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.332935 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2ecae630-2f6b-4335-9ec7-ba9aba895c7e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 404 to user: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:01:17.332935 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2ecae630-2f6b-4335-9ec7-ba9aba895c7e tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 404 len: 111 microversion: 2.1 time: 0.038443 Aug 08 17:01:17.332935 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 556/1115] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:01:17 2022] DELETE /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:01:17.342808 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7d41b7fa-4a94-428f-91a4-dc1d3037b487 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:17.344068 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7d41b7fa-4a94-428f-91a4-dc1d3037b487 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: 8cfbc416-d601-45f7-82e8-a6d09c30f448] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:17.352000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7d41b7fa-4a94-428f-91a4-dc1d3037b487 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.352495 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7d41b7fa-4a94-428f-91a4-dc1d3037b487 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.352944 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7d41b7fa-4a94-428f-91a4-dc1d3037b487 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.353663 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7d41b7fa-4a94-428f-91a4-dc1d3037b487 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.354157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7d41b7fa-4a94-428f-91a4-dc1d3037b487 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.354608 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7d41b7fa-4a94-428f-91a4-dc1d3037b487 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.371259 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-7d41b7fa-4a94-428f-91a4-dc1d3037b487 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7d41b7fa-4a94-428f-91a4-dc1d3037b487 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 HTTP/1.1 Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:01:17.372829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:01:17.377243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:01:17.377243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:17.377243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:17.377243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:17.377243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:17.377243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:01:17.377243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:01:17.377243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 17:01:17.377243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:17.377243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:01:17.377243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 17:01:17.377243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '8cfbc416-d601-45f7-82e8-a6d09c30f448'} Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:01:17.378148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. Aug 08 17:01:17.379596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:01:17.380929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7d41b7fa-4a94-428f-91a4-dc1d3037b487 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 404 to user: Instance 8cfbc416-d601-45f7-82e8-a6d09c30f448 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:01:17.380929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7d41b7fa-4a94-428f-91a4-dc1d3037b487 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448" status: 404 len: 111 microversion: 2.1 time: 0.040268 Aug 08 17:01:17.380929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 557/1116] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:17 2022] GET /compute/v2.1/servers/8cfbc416-d601-45f7-82e8-a6d09c30f448 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:01:17.393593 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-235fc70a-c9a0-4a5e-8c43-f80b0dd2f81c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:17.406651 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-235fc70a-c9a0-4a5e-8c43-f80b0dd2f81c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:17.409067 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-235fc70a-c9a0-4a5e-8c43-f80b0dd2f81c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:17.410457 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-235fc70a-c9a0-4a5e-8c43-f80b0dd2f81c tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1663 microversion: 2.20 time: 0.246997 Aug 08 17:01:17.411255 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 560/1117] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:17 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1663 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:17.438984 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-37399ab9-3ad5-45cc-82b4-8f669534f473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ed624d3-4634-419d-9bcf-f006910fa658"}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:17.442267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-37399ab9-3ad5-45cc-82b4-8f669534f473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:17.450718 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-37399ab9-3ad5-45cc-82b4-8f669534f473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.451878 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-37399ab9-3ad5-45cc-82b4-8f669534f473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.452717 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-37399ab9-3ad5-45cc-82b4-8f669534f473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:17.453509 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-37399ab9-3ad5-45cc-82b4-8f669534f473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:17.453965 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-37399ab9-3ad5-45cc-82b4-8f669534f473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:17.454388 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-37399ab9-3ad5-45cc-82b4-8f669534f473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:18.851186 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-128960c6-5116-452c-9dbd-02c035c70377 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:18.852278 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-128960c6-5116-452c-9dbd-02c035c70377 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:18.863769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-128960c6-5116-452c-9dbd-02c035c70377 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:18.870017 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-128960c6-5116-452c-9dbd-02c035c70377 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:18.870017 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-128960c6-5116-452c-9dbd-02c035c70377 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:18.870017 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-128960c6-5116-452c-9dbd-02c035c70377 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:18.870017 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-128960c6-5116-452c-9dbd-02c035c70377 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:18.870763 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-128960c6-5116-452c-9dbd-02c035c70377 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:18.883636 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-128960c6-5116-452c-9dbd-02c035c70377 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-128960c6-5116-452c-9dbd-02c035c70377 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: DELETE /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd HTTP/1.1 Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 17:01:18.885521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 17:01:18.889211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:01:18.889211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:18.889211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:18.889211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:18.889211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:18.889211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 17:01:18.889211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 17:01:18.889211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 17:01:18.889211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:18.889211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 17:01:18.889211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 17:01:18.889211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': 'e0affcec-8e4c-461a-ac29-5ac8d4fd92bd'} Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:01:18.891235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 17:01:18.893818 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:18.896656 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-128960c6-5116-452c-9dbd-02c035c70377 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 404 to user: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:01:18.896656 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-128960c6-5116-452c-9dbd-02c035c70377 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 404 len: 111 microversion: 2.1 time: 0.046710 Aug 08 17:01:18.896656 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 561/1118] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:01:18 2022] DELETE /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:01:18.899404 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4e400758-26a0-4664-96b7-8118dab20795 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:18.900017 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4e400758-26a0-4664-96b7-8118dab20795 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] [instance: e0affcec-8e4c-461a-ac29-5ac8d4fd92bd] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:18.907351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4e400758-26a0-4664-96b7-8118dab20795 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:18.908793 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4e400758-26a0-4664-96b7-8118dab20795 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:18.909270 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4e400758-26a0-4664-96b7-8118dab20795 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:18.910021 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4e400758-26a0-4664-96b7-8118dab20795 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:18.910955 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4e400758-26a0-4664-96b7-8118dab20795 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:18.911163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4e400758-26a0-4664-96b7-8118dab20795 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:18.924661 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-37399ab9-3ad5-45cc-82b4-8f669534f473 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "POST /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.492184 Aug 08 17:01:18.927624 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 558/1119] 10.222.0.13 () {62 vars in 1364 bytes} [Mon Aug 8 17:01:17 2022] POST /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/os-volume_attachments => generated 188 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 17:01:18.927928 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-4e400758-26a0-4664-96b7-8118dab20795 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] HTTP exception thrown: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4e400758-26a0-4664-96b7-8118dab20795 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Request method failure captured: Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd HTTP/1.1 Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T8vFYgU8cU0bfwmk0SzCzWLwX4QeOEiOjoGJN4NMQLWPaFl6zNn73df9imM1xFTcYYOFSasZy5bw1A_nwKE0BtbP6qub-OeMbD5_eqzuggyHqT4ekpX2lvu1TFAzST_lFyKs07TqEamp_OzPXPvQ4uEWR4Gg3Ihd-BLmwvMZFVs448 Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 17:01:18.929309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 17:01:18.932650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b2063a114c1942cab80ae4b708be9ab2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b2063a114c1942cab80ae4b708be9ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:01:18.932650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:18.932650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: b2063a114c1942cab80ae4b708be9ab2 Aug 08 17:01:18.932650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1446405313 Aug 08 17:01:18.932650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:18.932650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 17:01:18.932650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 17:01:18.932650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: fdb16e7edbe143e9b96325842896f04e Aug 08 17:01:18.932650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-AttachVolumeNegativeTest-1446405313-project Aug 08 17:01:18.932650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 17:01:18.932650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 17:01:18.932650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': 'e0affcec-8e4c-461a-ac29-5ac8d4fd92bd'} Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:01:18.934334 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. Aug 08 17:01:18.937472 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:01:18.941083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4e400758-26a0-4664-96b7-8118dab20795 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] Returning 404 to user: Instance e0affcec-8e4c-461a-ac29-5ac8d4fd92bd could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:01:18.941083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4e400758-26a0-4664-96b7-8118dab20795 tempest-AttachVolumeNegativeTest-1446405313 tempest-AttachVolumeNegativeTest-1446405313-project] 10.222.0.13 "GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd" status: 404 len: 111 microversion: 2.1 time: 0.035739 Aug 08 17:01:18.941083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 562/1120] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:18 2022] GET /compute/v2.1/servers/e0affcec-8e4c-461a-ac29-5ac8d4fd92bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 17:01:19.182006 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-8788a16f-ee62-4304-9963-8421dbafe82d req-b60f18f1-35c5-4840-bb10-2117131417a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37eeb765-0b75-4da4-be22-9fc72927ff6a", "name": "network-vif-unplugged", "status": "completed", "tag": "25f9ae20-5161-4130-bc9b-d7c23e20ddc0"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:19.219102 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7c2c66b0-2869-4349-b13f-66203ed631d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:19.219991 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7c2c66b0-2869-4349-b13f-66203ed631d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:19.236211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7c2c66b0-2869-4349-b13f-66203ed631d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:19.239358 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7c2c66b0-2869-4349-b13f-66203ed631d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:19.240455 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-8788a16f-ee62-4304-9963-8421dbafe82d req-b60f18f1-35c5-4840-bb10-2117131417a8 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:19.241031 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-8788a16f-ee62-4304-9963-8421dbafe82d req-b60f18f1-35c5-4840-bb10-2117131417a8 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:19.241476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-8788a16f-ee62-4304-9963-8421dbafe82d req-b60f18f1-35c5-4840-bb10-2117131417a8 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:19.242528 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7c2c66b0-2869-4349-b13f-66203ed631d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:19.243467 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7c2c66b0-2869-4349-b13f-66203ed631d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:19.244095 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7c2c66b0-2869-4349-b13f-66203ed631d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:19.244657 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7c2c66b0-2869-4349-b13f-66203ed631d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:19.256439 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.compute.server_external_events [req-8788a16f-ee62-4304-9963-8421dbafe82d req-b60f18f1-35c5-4840-bb10-2117131417a8 service nova] Unable to find a host for instance 37eeb765-0b75-4da4-be22-9fc72927ff6a. Dropping event network-vif-unplugged {{(pid=130235) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 08 17:01:19.257345 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-8788a16f-ee62-4304-9963-8421dbafe82d req-b60f18f1-35c5-4840-bb10-2117131417a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.082829 Aug 08 17:01:19.258551 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 559/1121] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 85 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 08 17:01:20.199691 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7c2c66b0-2869-4349-b13f-66203ed631d7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/os-volume_attachments/9ed624d3-4634-419d-9bcf-f006910fa658" status: 202 len: 0 microversion: 2.20 time: 1.006536 Aug 08 17:01:20.202623 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 563/1122] 10.222.0.13 () {60 vars in 1457 bytes} [Mon Aug 8 17:01:19 2022] DELETE /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/os-volume_attachments/9ed624d3-4634-419d-9bcf-f006910fa658 => generated 0 bytes in 1010 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:01:20.344643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-11f1e9f1-c52a-443b-b96c-fc3c945e48c4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:20.346354 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-11f1e9f1-c52a-443b-b96c-fc3c945e48c4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:20.359116 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11f1e9f1-c52a-443b-b96c-fc3c945e48c4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:20.360151 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11f1e9f1-c52a-443b-b96c-fc3c945e48c4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:20.361448 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11f1e9f1-c52a-443b-b96c-fc3c945e48c4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:20.362815 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11f1e9f1-c52a-443b-b96c-fc3c945e48c4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:20.363916 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11f1e9f1-c52a-443b-b96c-fc3c945e48c4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:20.364956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-11f1e9f1-c52a-443b-b96c-fc3c945e48c4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:20.431340 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-11f1e9f1-c52a-443b-b96c-fc3c945e48c4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130235) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 17:01:20.837233 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-11f1e9f1-c52a-443b-b96c-fc3c945e48c4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "POST /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/action" status: 202 len: 0 microversion: 2.20 time: 0.496666 Aug 08 17:01:20.844094 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 560/1123] 10.222.0.13 () {62 vars in 1319 bytes} [Mon Aug 8 17:01:20 2022] POST /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:01:20.861586 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4a060737-d68f-420b-9ef1-49e2ce08512b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:20.864069 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4a060737-d68f-420b-9ef1-49e2ce08512b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:20.871468 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:20.879842 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a060737-d68f-420b-9ef1-49e2ce08512b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:20.885283 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a060737-d68f-420b-9ef1-49e2ce08512b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:20.885283 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a060737-d68f-420b-9ef1-49e2ce08512b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:20.885283 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a060737-d68f-420b-9ef1-49e2ce08512b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:20.885283 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a060737-d68f-420b-9ef1-49e2ce08512b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:20.885907 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a060737-d68f-420b-9ef1-49e2ce08512b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:21.167752 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4a060737-d68f-420b-9ef1-49e2ce08512b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:21.184758 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4a060737-d68f-420b-9ef1-49e2ce08512b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:21.188815 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4a060737-d68f-420b-9ef1-49e2ce08512b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:21.191754 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4a060737-d68f-420b-9ef1-49e2ce08512b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1671 microversion: 2.20 time: 0.343084 Aug 08 17:01:21.208338 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 564/1124] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:20 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1671 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:22.232394 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f91a6a67-6a8d-4f96-bc6b-e9c3c0060b31 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:22.237999 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f91a6a67-6a8d-4f96-bc6b-e9c3c0060b31 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:22.248558 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f91a6a67-6a8d-4f96-bc6b-e9c3c0060b31 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:22.249743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f91a6a67-6a8d-4f96-bc6b-e9c3c0060b31 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:22.250822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f91a6a67-6a8d-4f96-bc6b-e9c3c0060b31 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:22.251875 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f91a6a67-6a8d-4f96-bc6b-e9c3c0060b31 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:22.252610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f91a6a67-6a8d-4f96-bc6b-e9c3c0060b31 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:22.253430 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f91a6a67-6a8d-4f96-bc6b-e9c3c0060b31 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:22.493429 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f91a6a67-6a8d-4f96-bc6b-e9c3c0060b31 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:22.509895 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f91a6a67-6a8d-4f96-bc6b-e9c3c0060b31 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:22.511740 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f91a6a67-6a8d-4f96-bc6b-e9c3c0060b31 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:22.517103 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f91a6a67-6a8d-4f96-bc6b-e9c3c0060b31 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1671 microversion: 2.20 time: 0.287402 Aug 08 17:01:22.517746 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 561/1125] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:22 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1671 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:23.584939 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9efc201a-6234-4ff9-99a0-c8a004d16150 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:23.590485 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9efc201a-6234-4ff9-99a0-c8a004d16150 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:23.601267 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9efc201a-6234-4ff9-99a0-c8a004d16150 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:23.602098 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9efc201a-6234-4ff9-99a0-c8a004d16150 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:23.603695 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9efc201a-6234-4ff9-99a0-c8a004d16150 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:23.605759 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9efc201a-6234-4ff9-99a0-c8a004d16150 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:23.606770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9efc201a-6234-4ff9-99a0-c8a004d16150 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:23.608015 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9efc201a-6234-4ff9-99a0-c8a004d16150 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:23.906608 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9efc201a-6234-4ff9-99a0-c8a004d16150 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:23.943701 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9efc201a-6234-4ff9-99a0-c8a004d16150 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:23.946603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9efc201a-6234-4ff9-99a0-c8a004d16150 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:23.948307 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9efc201a-6234-4ff9-99a0-c8a004d16150 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.379916 Aug 08 17:01:23.949158 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 565/1126] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:23 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:24.984848 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d1b0d5b3-36b4-435e-8e94-53f9ab052ebf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:24.985546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d1b0d5b3-36b4-435e-8e94-53f9ab052ebf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:24.998710 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d1b0d5b3-36b4-435e-8e94-53f9ab052ebf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:24.999092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d1b0d5b3-36b4-435e-8e94-53f9ab052ebf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:24.999541 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d1b0d5b3-36b4-435e-8e94-53f9ab052ebf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:25.000260 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d1b0d5b3-36b4-435e-8e94-53f9ab052ebf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:25.000729 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d1b0d5b3-36b4-435e-8e94-53f9ab052ebf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:25.003564 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d1b0d5b3-36b4-435e-8e94-53f9ab052ebf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:25.277694 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d1b0d5b3-36b4-435e-8e94-53f9ab052ebf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:25.290916 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d1b0d5b3-36b4-435e-8e94-53f9ab052ebf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:25.292480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d1b0d5b3-36b4-435e-8e94-53f9ab052ebf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:25.293716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d1b0d5b3-36b4-435e-8e94-53f9ab052ebf tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.317167 Aug 08 17:01:25.294299 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 562/1127] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:24 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:26.322471 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f818666b-644c-4a0a-83e5-4d5cfe8c0e7b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:26.324774 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f818666b-644c-4a0a-83e5-4d5cfe8c0e7b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:26.337352 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f818666b-644c-4a0a-83e5-4d5cfe8c0e7b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:26.339417 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f818666b-644c-4a0a-83e5-4d5cfe8c0e7b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:26.340795 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f818666b-644c-4a0a-83e5-4d5cfe8c0e7b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:26.343037 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f818666b-644c-4a0a-83e5-4d5cfe8c0e7b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:26.343827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f818666b-644c-4a0a-83e5-4d5cfe8c0e7b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:26.344732 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f818666b-644c-4a0a-83e5-4d5cfe8c0e7b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:26.719020 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f818666b-644c-4a0a-83e5-4d5cfe8c0e7b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:26.742285 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f818666b-644c-4a0a-83e5-4d5cfe8c0e7b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:26.751121 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f818666b-644c-4a0a-83e5-4d5cfe8c0e7b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:26.753873 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f818666b-644c-4a0a-83e5-4d5cfe8c0e7b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.438617 Aug 08 17:01:26.759765 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 566/1128] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:26 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:01:27.793547 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0e986ad3-77db-45a8-8c14-f4a0af4fdc97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:27.795284 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0e986ad3-77db-45a8-8c14-f4a0af4fdc97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:27.802292 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e986ad3-77db-45a8-8c14-f4a0af4fdc97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:27.803081 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e986ad3-77db-45a8-8c14-f4a0af4fdc97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:27.803675 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e986ad3-77db-45a8-8c14-f4a0af4fdc97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:27.804563 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e986ad3-77db-45a8-8c14-f4a0af4fdc97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:27.805180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e986ad3-77db-45a8-8c14-f4a0af4fdc97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:27.805827 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e986ad3-77db-45a8-8c14-f4a0af4fdc97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:27.994141 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0e986ad3-77db-45a8-8c14-f4a0af4fdc97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:28.014951 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0e986ad3-77db-45a8-8c14-f4a0af4fdc97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:28.019102 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0e986ad3-77db-45a8-8c14-f4a0af4fdc97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:28.022183 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0e986ad3-77db-45a8-8c14-f4a0af4fdc97 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.235823 Aug 08 17:01:28.029777 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 563/1129] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:27 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:29.052139 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f2aa6845-1b7f-47ab-9b0e-6aaee5768a4b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:29.054115 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f2aa6845-1b7f-47ab-9b0e-6aaee5768a4b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:29.062492 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f2aa6845-1b7f-47ab-9b0e-6aaee5768a4b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:29.064881 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f2aa6845-1b7f-47ab-9b0e-6aaee5768a4b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:29.066449 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f2aa6845-1b7f-47ab-9b0e-6aaee5768a4b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:29.067839 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f2aa6845-1b7f-47ab-9b0e-6aaee5768a4b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:29.069217 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f2aa6845-1b7f-47ab-9b0e-6aaee5768a4b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:29.077299 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f2aa6845-1b7f-47ab-9b0e-6aaee5768a4b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:29.377940 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f2aa6845-1b7f-47ab-9b0e-6aaee5768a4b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:29.399119 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f2aa6845-1b7f-47ab-9b0e-6aaee5768a4b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:29.401439 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f2aa6845-1b7f-47ab-9b0e-6aaee5768a4b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:29.403093 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f2aa6845-1b7f-47ab-9b0e-6aaee5768a4b tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.356647 Aug 08 17:01:29.420242 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 567/1130] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:29 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:30.433918 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1ab717f9-fba2-423b-8140-34eb1a434965 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:30.434862 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1ab717f9-fba2-423b-8140-34eb1a434965 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:30.444493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ab717f9-fba2-423b-8140-34eb1a434965 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:30.444996 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ab717f9-fba2-423b-8140-34eb1a434965 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:30.445441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ab717f9-fba2-423b-8140-34eb1a434965 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:30.446811 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ab717f9-fba2-423b-8140-34eb1a434965 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:30.447476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ab717f9-fba2-423b-8140-34eb1a434965 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:30.448153 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1ab717f9-fba2-423b-8140-34eb1a434965 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:30.618692 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2397a41b-915a-4f56-8a04-9dcf4fcad5c6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:30.619973 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2397a41b-915a-4f56-8a04-9dcf4fcad5c6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:30.663144 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2397a41b-915a-4f56-8a04-9dcf4fcad5c6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:30.664326 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2397a41b-915a-4f56-8a04-9dcf4fcad5c6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:30.664802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2397a41b-915a-4f56-8a04-9dcf4fcad5c6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:30.665607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2397a41b-915a-4f56-8a04-9dcf4fcad5c6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:30.666106 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2397a41b-915a-4f56-8a04-9dcf4fcad5c6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:30.666550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2397a41b-915a-4f56-8a04-9dcf4fcad5c6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:30.697015 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-2397a41b-915a-4f56-8a04-9dcf4fcad5c6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lazy-loading 'flavor' on Instance uuid eff2191f-71f9-44b6-ae73-7e7385c80748 {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:01:30.730617 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1ab717f9-fba2-423b-8140-34eb1a434965 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:30.751628 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1ab717f9-fba2-423b-8140-34eb1a434965 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:30.755881 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1ab717f9-fba2-423b-8140-34eb1a434965 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:30.759441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1ab717f9-fba2-423b-8140-34eb1a434965 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.330266 Aug 08 17:01:30.759441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 564/1131] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:30 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:31.167074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2397a41b-915a-4f56-8a04-9dcf4fcad5c6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "POST /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748/action" status: 202 len: 0 microversion: 2.1 time: 0.576240 Aug 08 17:01:31.168170 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 568/1132] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 17:01:30 2022] POST /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:01:31.181353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8c2eb12f-57a7-49eb-818c-1689f5e868f6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:31.182294 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8c2eb12f-57a7-49eb-818c-1689f5e868f6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:31.190674 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8c2eb12f-57a7-49eb-818c-1689f5e868f6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:31.190674 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8c2eb12f-57a7-49eb-818c-1689f5e868f6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:31.190674 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8c2eb12f-57a7-49eb-818c-1689f5e868f6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:31.191173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8c2eb12f-57a7-49eb-818c-1689f5e868f6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:31.191411 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8c2eb12f-57a7-49eb-818c-1689f5e868f6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:31.191841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8c2eb12f-57a7-49eb-818c-1689f5e868f6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:31.423781 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8c2eb12f-57a7-49eb-818c-1689f5e868f6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:31.442320 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8c2eb12f-57a7-49eb-818c-1689f5e868f6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.265528 Aug 08 17:01:31.457145 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 565/1133] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:31 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:31.787127 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-62764d3f-d046-4349-ae66-32d808f34624 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:31.788383 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-62764d3f-d046-4349-ae66-32d808f34624 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:31.797928 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-62764d3f-d046-4349-ae66-32d808f34624 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:31.798788 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-62764d3f-d046-4349-ae66-32d808f34624 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:31.799511 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-62764d3f-d046-4349-ae66-32d808f34624 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:31.800816 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-62764d3f-d046-4349-ae66-32d808f34624 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:31.802127 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-62764d3f-d046-4349-ae66-32d808f34624 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:31.803158 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-62764d3f-d046-4349-ae66-32d808f34624 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:32.085044 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-62764d3f-d046-4349-ae66-32d808f34624 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:32.108198 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-62764d3f-d046-4349-ae66-32d808f34624 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:32.136753 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-62764d3f-d046-4349-ae66-32d808f34624 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:32.141589 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-62764d3f-d046-4349-ae66-32d808f34624 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.360340 Aug 08 17:01:32.143677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 569/1134] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:31 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:32.466469 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-69c79364-b519-49d7-93c2-1d3208dd6afe tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:32.467933 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-69c79364-b519-49d7-93c2-1d3208dd6afe tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:32.490118 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-69c79364-b519-49d7-93c2-1d3208dd6afe tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:32.491118 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-69c79364-b519-49d7-93c2-1d3208dd6afe tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:32.491566 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-69c79364-b519-49d7-93c2-1d3208dd6afe tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:32.493254 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-69c79364-b519-49d7-93c2-1d3208dd6afe tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:32.494326 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-69c79364-b519-49d7-93c2-1d3208dd6afe tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:32.495128 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-69c79364-b519-49d7-93c2-1d3208dd6afe tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:32.734303 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-69c79364-b519-49d7-93c2-1d3208dd6afe tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:32.751733 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-69c79364-b519-49d7-93c2-1d3208dd6afe tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.287906 Aug 08 17:01:32.754868 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 566/1135] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:32 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:33.173851 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9ffd361b-a267-4a3a-993d-66cbb319f379 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:33.205440 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9ffd361b-a267-4a3a-993d-66cbb319f379 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:33.205440 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9ffd361b-a267-4a3a-993d-66cbb319f379 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:33.205440 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9ffd361b-a267-4a3a-993d-66cbb319f379 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:33.205440 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9ffd361b-a267-4a3a-993d-66cbb319f379 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:33.205856 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9ffd361b-a267-4a3a-993d-66cbb319f379 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:33.205856 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9ffd361b-a267-4a3a-993d-66cbb319f379 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:33.205856 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9ffd361b-a267-4a3a-993d-66cbb319f379 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:33.355821 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9ffd361b-a267-4a3a-993d-66cbb319f379 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:33.368994 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9ffd361b-a267-4a3a-993d-66cbb319f379 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:33.371463 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9ffd361b-a267-4a3a-993d-66cbb319f379 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:33.374267 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9ffd361b-a267-4a3a-993d-66cbb319f379 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.205356 Aug 08 17:01:33.388783 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 570/1136] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:33 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:33.778786 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-aafdd5a3-a0e0-4f53-8f77-09f6528197a5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:33.778786 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-aafdd5a3-a0e0-4f53-8f77-09f6528197a5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:33.785648 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aafdd5a3-a0e0-4f53-8f77-09f6528197a5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:33.786435 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aafdd5a3-a0e0-4f53-8f77-09f6528197a5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:33.787061 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aafdd5a3-a0e0-4f53-8f77-09f6528197a5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:33.787944 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aafdd5a3-a0e0-4f53-8f77-09f6528197a5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:33.788591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aafdd5a3-a0e0-4f53-8f77-09f6528197a5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:33.789206 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-aafdd5a3-a0e0-4f53-8f77-09f6528197a5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:34.006154 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-aafdd5a3-a0e0-4f53-8f77-09f6528197a5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:34.015883 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-aafdd5a3-a0e0-4f53-8f77-09f6528197a5 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.242453 Aug 08 17:01:34.016470 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 567/1137] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:33 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:34.405696 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8fb0289a-e0db-4ad4-8562-20d80b5b8571 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:34.405696 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8fb0289a-e0db-4ad4-8562-20d80b5b8571 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:34.411772 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8fb0289a-e0db-4ad4-8562-20d80b5b8571 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:34.412541 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8fb0289a-e0db-4ad4-8562-20d80b5b8571 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:34.413194 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8fb0289a-e0db-4ad4-8562-20d80b5b8571 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:34.414127 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8fb0289a-e0db-4ad4-8562-20d80b5b8571 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:34.414813 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8fb0289a-e0db-4ad4-8562-20d80b5b8571 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:34.415463 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8fb0289a-e0db-4ad4-8562-20d80b5b8571 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:34.440860 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:34.573712 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8fb0289a-e0db-4ad4-8562-20d80b5b8571 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:34.581880 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8fb0289a-e0db-4ad4-8562-20d80b5b8571 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:34.583412 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8fb0289a-e0db-4ad4-8562-20d80b5b8571 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:34.586109 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-8fb0289a-e0db-4ad4-8562-20d80b5b8571 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.187625 Aug 08 17:01:34.586109 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 571/1138] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:34 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:35.038833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a0757dd6-e2af-406c-8462-d962fc73e920 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:35.039812 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a0757dd6-e2af-406c-8462-d962fc73e920 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:35.054847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a0757dd6-e2af-406c-8462-d962fc73e920 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:35.054847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a0757dd6-e2af-406c-8462-d962fc73e920 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:35.054847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a0757dd6-e2af-406c-8462-d962fc73e920 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:35.054847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a0757dd6-e2af-406c-8462-d962fc73e920 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:35.055245 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a0757dd6-e2af-406c-8462-d962fc73e920 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:35.055245 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a0757dd6-e2af-406c-8462-d962fc73e920 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:35.196272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a0757dd6-e2af-406c-8462-d962fc73e920 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:35.204219 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a0757dd6-e2af-406c-8462-d962fc73e920 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.170976 Aug 08 17:01:35.204802 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 568/1139] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:35 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:35.610201 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f7d34a2b-6e52-4830-8948-1bfc41c124dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:35.611047 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f7d34a2b-6e52-4830-8948-1bfc41c124dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:35.618805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f7d34a2b-6e52-4830-8948-1bfc41c124dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:35.619356 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f7d34a2b-6e52-4830-8948-1bfc41c124dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:35.619800 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f7d34a2b-6e52-4830-8948-1bfc41c124dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:35.620535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f7d34a2b-6e52-4830-8948-1bfc41c124dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:35.621018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f7d34a2b-6e52-4830-8948-1bfc41c124dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:35.621478 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f7d34a2b-6e52-4830-8948-1bfc41c124dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:35.793576 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f7d34a2b-6e52-4830-8948-1bfc41c124dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:35.801605 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f7d34a2b-6e52-4830-8948-1bfc41c124dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:35.803131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f7d34a2b-6e52-4830-8948-1bfc41c124dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:35.804305 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f7d34a2b-6e52-4830-8948-1bfc41c124dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.199591 Aug 08 17:01:35.804875 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 572/1140] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:35 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:36.226439 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-da629a41-6e45-479a-b790-f1bcfefeb983 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:36.227204 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-da629a41-6e45-479a-b790-f1bcfefeb983 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:36.234292 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-da629a41-6e45-479a-b790-f1bcfefeb983 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:36.235162 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-da629a41-6e45-479a-b790-f1bcfefeb983 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:36.235689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-da629a41-6e45-479a-b790-f1bcfefeb983 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:36.236420 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-da629a41-6e45-479a-b790-f1bcfefeb983 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:36.236818 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-da629a41-6e45-479a-b790-f1bcfefeb983 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:36.237246 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-da629a41-6e45-479a-b790-f1bcfefeb983 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:36.241674 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:36.401708 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-da629a41-6e45-479a-b790-f1bcfefeb983 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:36.420280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-da629a41-6e45-479a-b790-f1bcfefeb983 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.190833 Aug 08 17:01:36.420280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 569/1141] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:36 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:36.827735 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-20cb7685-f32b-4283-8c50-c7cd16f4fbb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:36.828540 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-20cb7685-f32b-4283-8c50-c7cd16f4fbb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:36.836037 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20cb7685-f32b-4283-8c50-c7cd16f4fbb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:36.836618 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20cb7685-f32b-4283-8c50-c7cd16f4fbb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:36.837059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20cb7685-f32b-4283-8c50-c7cd16f4fbb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:36.837771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20cb7685-f32b-4283-8c50-c7cd16f4fbb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:36.838299 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20cb7685-f32b-4283-8c50-c7cd16f4fbb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:36.838761 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-20cb7685-f32b-4283-8c50-c7cd16f4fbb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:36.992548 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-20cb7685-f32b-4283-8c50-c7cd16f4fbb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:37.001947 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-20cb7685-f32b-4283-8c50-c7cd16f4fbb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:37.003912 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-20cb7685-f32b-4283-8c50-c7cd16f4fbb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:37.004603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-20cb7685-f32b-4283-8c50-c7cd16f4fbb2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.181694 Aug 08 17:01:37.005167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 573/1142] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:36 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:37.454353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-44d8ba35-3c9f-425f-a64f-50b0be2473b6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:37.454966 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-44d8ba35-3c9f-425f-a64f-50b0be2473b6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:37.461645 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44d8ba35-3c9f-425f-a64f-50b0be2473b6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:37.462134 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44d8ba35-3c9f-425f-a64f-50b0be2473b6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:37.462588 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44d8ba35-3c9f-425f-a64f-50b0be2473b6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:37.463304 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44d8ba35-3c9f-425f-a64f-50b0be2473b6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:37.463762 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44d8ba35-3c9f-425f-a64f-50b0be2473b6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:37.464290 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-44d8ba35-3c9f-425f-a64f-50b0be2473b6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:37.616619 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-44d8ba35-3c9f-425f-a64f-50b0be2473b6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:37.626441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-44d8ba35-3c9f-425f-a64f-50b0be2473b6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.176465 Aug 08 17:01:37.627108 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 570/1143] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:37 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:38.028176 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ec36dae7-3243-4688-8819-c664ed8ec105 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:38.028798 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ec36dae7-3243-4688-8819-c664ed8ec105 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:38.036515 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ec36dae7-3243-4688-8819-c664ed8ec105 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:38.036933 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ec36dae7-3243-4688-8819-c664ed8ec105 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:38.037376 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ec36dae7-3243-4688-8819-c664ed8ec105 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:38.038093 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ec36dae7-3243-4688-8819-c664ed8ec105 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:38.038551 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ec36dae7-3243-4688-8819-c664ed8ec105 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:38.039025 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ec36dae7-3243-4688-8819-c664ed8ec105 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:38.207481 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ec36dae7-3243-4688-8819-c664ed8ec105 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:38.220271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ec36dae7-3243-4688-8819-c664ed8ec105 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:38.222188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ec36dae7-3243-4688-8819-c664ed8ec105 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:38.223864 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ec36dae7-3243-4688-8819-c664ed8ec105 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.199603 Aug 08 17:01:38.234950 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 574/1144] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:38 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:38.648614 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-dd73c4ef-037b-4460-82cf-b523251d96c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:38.649232 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-dd73c4ef-037b-4460-82cf-b523251d96c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:38.651559 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:38.657496 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd73c4ef-037b-4460-82cf-b523251d96c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:38.658872 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd73c4ef-037b-4460-82cf-b523251d96c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:38.659539 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd73c4ef-037b-4460-82cf-b523251d96c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:38.660500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd73c4ef-037b-4460-82cf-b523251d96c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:38.661530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd73c4ef-037b-4460-82cf-b523251d96c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:38.662042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dd73c4ef-037b-4460-82cf-b523251d96c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:38.851279 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-dd73c4ef-037b-4460-82cf-b523251d96c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:38.867924 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-dd73c4ef-037b-4460-82cf-b523251d96c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.220381 Aug 08 17:01:38.867924 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 571/1145] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:38 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:39.248365 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-bcacb35a-2a85-4fb9-93fd-7f3d6bca0506 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:39.249059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-bcacb35a-2a85-4fb9-93fd-7f3d6bca0506 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:39.258922 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bcacb35a-2a85-4fb9-93fd-7f3d6bca0506 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:39.259569 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bcacb35a-2a85-4fb9-93fd-7f3d6bca0506 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:39.260235 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bcacb35a-2a85-4fb9-93fd-7f3d6bca0506 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:39.261028 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bcacb35a-2a85-4fb9-93fd-7f3d6bca0506 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:39.261571 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bcacb35a-2a85-4fb9-93fd-7f3d6bca0506 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:39.262201 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-bcacb35a-2a85-4fb9-93fd-7f3d6bca0506 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:39.474887 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bcacb35a-2a85-4fb9-93fd-7f3d6bca0506 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:39.488370 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bcacb35a-2a85-4fb9-93fd-7f3d6bca0506 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:39.489961 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-bcacb35a-2a85-4fb9-93fd-7f3d6bca0506 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:39.491214 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-bcacb35a-2a85-4fb9-93fd-7f3d6bca0506 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.247232 Aug 08 17:01:39.492045 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 575/1146] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:39 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:01:39.895937 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fac25038-0bd9-46ed-a1e1-a2f90093b496 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:39.896929 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fac25038-0bd9-46ed-a1e1-a2f90093b496 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:39.905475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fac25038-0bd9-46ed-a1e1-a2f90093b496 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:39.906003 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fac25038-0bd9-46ed-a1e1-a2f90093b496 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:39.907925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fac25038-0bd9-46ed-a1e1-a2f90093b496 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:39.908688 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fac25038-0bd9-46ed-a1e1-a2f90093b496 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:39.909154 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fac25038-0bd9-46ed-a1e1-a2f90093b496 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:39.909587 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fac25038-0bd9-46ed-a1e1-a2f90093b496 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:40.058190 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fac25038-0bd9-46ed-a1e1-a2f90093b496 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:40.066744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fac25038-0bd9-46ed-a1e1-a2f90093b496 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.181504 Aug 08 17:01:40.074461 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 572/1147] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:39 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:40.517328 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-220daa5e-37a0-4d17-8443-783ebe29b5b7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:40.518583 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-220daa5e-37a0-4d17-8443-783ebe29b5b7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:40.525550 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-220daa5e-37a0-4d17-8443-783ebe29b5b7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:40.526047 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-220daa5e-37a0-4d17-8443-783ebe29b5b7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:40.526921 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-220daa5e-37a0-4d17-8443-783ebe29b5b7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:40.527270 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-220daa5e-37a0-4d17-8443-783ebe29b5b7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:40.528097 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-220daa5e-37a0-4d17-8443-783ebe29b5b7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:40.528696 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-220daa5e-37a0-4d17-8443-783ebe29b5b7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:40.669155 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-220daa5e-37a0-4d17-8443-783ebe29b5b7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:40.678934 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-220daa5e-37a0-4d17-8443-783ebe29b5b7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:40.681952 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-220daa5e-37a0-4d17-8443-783ebe29b5b7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:40.681952 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-220daa5e-37a0-4d17-8443-783ebe29b5b7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.169565 Aug 08 17:01:40.682476 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 576/1148] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:40 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:41.089383 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8d2fd876-c341-4792-943f-8f771d111c8d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:41.090016 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8d2fd876-c341-4792-943f-8f771d111c8d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:41.099883 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d2fd876-c341-4792-943f-8f771d111c8d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:41.104588 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d2fd876-c341-4792-943f-8f771d111c8d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:41.104588 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d2fd876-c341-4792-943f-8f771d111c8d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:41.104588 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d2fd876-c341-4792-943f-8f771d111c8d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:41.104588 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d2fd876-c341-4792-943f-8f771d111c8d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:41.104932 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d2fd876-c341-4792-943f-8f771d111c8d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:41.305383 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8d2fd876-c341-4792-943f-8f771d111c8d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:41.314840 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8d2fd876-c341-4792-943f-8f771d111c8d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.229264 Aug 08 17:01:41.315736 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 573/1149] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:41 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:41.705569 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9a6280b2-987f-4772-9558-41c7f6fe813f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:41.706281 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9a6280b2-987f-4772-9558-41c7f6fe813f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:41.713539 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a6280b2-987f-4772-9558-41c7f6fe813f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:41.714631 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a6280b2-987f-4772-9558-41c7f6fe813f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:41.715040 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a6280b2-987f-4772-9558-41c7f6fe813f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:41.715756 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a6280b2-987f-4772-9558-41c7f6fe813f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:41.716207 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a6280b2-987f-4772-9558-41c7f6fe813f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:41.716641 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a6280b2-987f-4772-9558-41c7f6fe813f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:41.868201 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9a6280b2-987f-4772-9558-41c7f6fe813f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:41.875033 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9a6280b2-987f-4772-9558-41c7f6fe813f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:41.877101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9a6280b2-987f-4772-9558-41c7f6fe813f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:41.878276 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9a6280b2-987f-4772-9558-41c7f6fe813f tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.176980 Aug 08 17:01:41.878872 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 577/1150] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:41 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:42.340173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c7d52d43-af24-4c54-a8c4-f0fb4c97497a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:42.340173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c7d52d43-af24-4c54-a8c4-f0fb4c97497a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:42.350973 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c7d52d43-af24-4c54-a8c4-f0fb4c97497a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:42.350973 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c7d52d43-af24-4c54-a8c4-f0fb4c97497a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:42.350973 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c7d52d43-af24-4c54-a8c4-f0fb4c97497a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:42.350973 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c7d52d43-af24-4c54-a8c4-f0fb4c97497a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:42.351371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c7d52d43-af24-4c54-a8c4-f0fb4c97497a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:42.351371 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-c7d52d43-af24-4c54-a8c4-f0fb4c97497a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:42.503418 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-fb1dc043-800e-460c-9755-c10aa90748b6 req-5e64c804-b4d1-418e-b0e8-94c1985cc7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37eeb765-0b75-4da4-be22-9fc72927ff6a", "name": "network-vif-plugged", "status": "completed", "tag": "25f9ae20-5161-4130-bc9b-d7c23e20ddc0"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:42.517613 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-fb1dc043-800e-460c-9755-c10aa90748b6 req-5e64c804-b4d1-418e-b0e8-94c1985cc7f7 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:42.518383 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-fb1dc043-800e-460c-9755-c10aa90748b6 req-5e64c804-b4d1-418e-b0e8-94c1985cc7f7 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:42.519044 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-fb1dc043-800e-460c-9755-c10aa90748b6 req-5e64c804-b4d1-418e-b0e8-94c1985cc7f7 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:42.534153 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-fb1dc043-800e-460c-9755-c10aa90748b6 req-5e64c804-b4d1-418e-b0e8-94c1985cc7f7 service nova] Creating event network-vif-plugged:25f9ae20-5161-4130-bc9b-d7c23e20ddc0 for instance 37eeb765-0b75-4da4-be22-9fc72927ff6a on hv-cinder-85220 Aug 08 17:01:42.540052 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-fb1dc043-800e-460c-9755-c10aa90748b6 req-5e64c804-b4d1-418e-b0e8-94c1985cc7f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040904 Aug 08 17:01:42.540986 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 578/1151] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:01:42.625986 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c7d52d43-af24-4c54-a8c4-f0fb4c97497a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:42.631413 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c7d52d43-af24-4c54-a8c4-f0fb4c97497a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.298265 Aug 08 17:01:42.632001 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 574/1152] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:42 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:42.902816 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4209488f-f8ea-4657-b257-2636379f2cd0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:42.903567 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4209488f-f8ea-4657-b257-2636379f2cd0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:42.910177 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4209488f-f8ea-4657-b257-2636379f2cd0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:42.911867 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4209488f-f8ea-4657-b257-2636379f2cd0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:42.912317 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4209488f-f8ea-4657-b257-2636379f2cd0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:42.913036 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4209488f-f8ea-4657-b257-2636379f2cd0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:42.913498 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4209488f-f8ea-4657-b257-2636379f2cd0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:42.913961 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4209488f-f8ea-4657-b257-2636379f2cd0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:43.064111 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4209488f-f8ea-4657-b257-2636379f2cd0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:43.073029 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4209488f-f8ea-4657-b257-2636379f2cd0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:43.074614 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4209488f-f8ea-4657-b257-2636379f2cd0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:43.075930 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4209488f-f8ea-4657-b257-2636379f2cd0 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.178072 Aug 08 17:01:43.076521 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 579/1153] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:42 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:43.653805 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b13211f1-7602-4a99-a475-9c5d8000df53 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:43.654627 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b13211f1-7602-4a99-a475-9c5d8000df53 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:43.665769 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b13211f1-7602-4a99-a475-9c5d8000df53 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:43.667578 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b13211f1-7602-4a99-a475-9c5d8000df53 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:43.667578 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b13211f1-7602-4a99-a475-9c5d8000df53 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:43.668470 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b13211f1-7602-4a99-a475-9c5d8000df53 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:43.670140 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b13211f1-7602-4a99-a475-9c5d8000df53 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:43.670962 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b13211f1-7602-4a99-a475-9c5d8000df53 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:44.104503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b7c92ea4-2abc-4f49-ac17-e2c28f7e2171 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:44.105142 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b7c92ea4-2abc-4f49-ac17-e2c28f7e2171 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:44.113751 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b7c92ea4-2abc-4f49-ac17-e2c28f7e2171 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:44.114652 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b7c92ea4-2abc-4f49-ac17-e2c28f7e2171 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:44.115083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b7c92ea4-2abc-4f49-ac17-e2c28f7e2171 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:44.115994 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b7c92ea4-2abc-4f49-ac17-e2c28f7e2171 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:44.116441 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b7c92ea4-2abc-4f49-ac17-e2c28f7e2171 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:44.117051 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b7c92ea4-2abc-4f49-ac17-e2c28f7e2171 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:44.225202 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b13211f1-7602-4a99-a475-9c5d8000df53 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:44.242597 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b13211f1-7602-4a99-a475-9c5d8000df53 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.592618 Aug 08 17:01:44.243695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 575/1154] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:43 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:44.284751 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b7c92ea4-2abc-4f49-ac17-e2c28f7e2171 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:44.298940 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b7c92ea4-2abc-4f49-ac17-e2c28f7e2171 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:44.298940 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b7c92ea4-2abc-4f49-ac17-e2c28f7e2171 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:44.298940 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b7c92ea4-2abc-4f49-ac17-e2c28f7e2171 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.197949 Aug 08 17:01:44.299495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 580/1155] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:44 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:45.279456 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-baec4776-0207-46cd-9f51-e5d679a650c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:45.280094 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-baec4776-0207-46cd-9f51-e5d679a650c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:45.287003 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-baec4776-0207-46cd-9f51-e5d679a650c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:45.287572 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-baec4776-0207-46cd-9f51-e5d679a650c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:45.287914 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-baec4776-0207-46cd-9f51-e5d679a650c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:45.288614 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-baec4776-0207-46cd-9f51-e5d679a650c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:45.289061 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-baec4776-0207-46cd-9f51-e5d679a650c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:45.289485 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-baec4776-0207-46cd-9f51-e5d679a650c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:45.325098 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fc67a8a5-9b41-4672-a2b1-46c2fec83cfc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:45.330604 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fc67a8a5-9b41-4672-a2b1-46c2fec83cfc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:45.332543 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fc67a8a5-9b41-4672-a2b1-46c2fec83cfc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:45.333037 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fc67a8a5-9b41-4672-a2b1-46c2fec83cfc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:45.333525 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fc67a8a5-9b41-4672-a2b1-46c2fec83cfc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:45.334274 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fc67a8a5-9b41-4672-a2b1-46c2fec83cfc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:45.334771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fc67a8a5-9b41-4672-a2b1-46c2fec83cfc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:45.335203 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fc67a8a5-9b41-4672-a2b1-46c2fec83cfc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:45.495378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-baec4776-0207-46cd-9f51-e5d679a650c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:45.505640 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-baec4776-0207-46cd-9f51-e5d679a650c3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.230070 Aug 08 17:01:45.506546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 576/1156] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:45 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:45.557802 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fc67a8a5-9b41-4672-a2b1-46c2fec83cfc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:45.573193 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fc67a8a5-9b41-4672-a2b1-46c2fec83cfc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:45.573193 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fc67a8a5-9b41-4672-a2b1-46c2fec83cfc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:45.573193 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fc67a8a5-9b41-4672-a2b1-46c2fec83cfc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.250388 Aug 08 17:01:45.573473 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 581/1157] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:45 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:01:46.528443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-915f4290-3064-476b-b5c9-b9600c9bb339 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:46.529706 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-915f4290-3064-476b-b5c9-b9600c9bb339 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:46.537480 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-915f4290-3064-476b-b5c9-b9600c9bb339 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:46.538093 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-915f4290-3064-476b-b5c9-b9600c9bb339 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:46.538405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-915f4290-3064-476b-b5c9-b9600c9bb339 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:46.539312 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-915f4290-3064-476b-b5c9-b9600c9bb339 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:46.539697 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-915f4290-3064-476b-b5c9-b9600c9bb339 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:46.540113 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-915f4290-3064-476b-b5c9-b9600c9bb339 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:46.597628 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-21eab0ce-acdd-4789-b856-e3cedb0302f6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:46.597628 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-21eab0ce-acdd-4789-b856-e3cedb0302f6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:46.604032 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-21eab0ce-acdd-4789-b856-e3cedb0302f6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:46.604799 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-21eab0ce-acdd-4789-b856-e3cedb0302f6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:46.605431 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-21eab0ce-acdd-4789-b856-e3cedb0302f6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:46.606317 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-21eab0ce-acdd-4789-b856-e3cedb0302f6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:46.607105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-21eab0ce-acdd-4789-b856-e3cedb0302f6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:46.608157 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-21eab0ce-acdd-4789-b856-e3cedb0302f6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:47.002172 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-21eab0ce-acdd-4789-b856-e3cedb0302f6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:47.014300 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-21eab0ce-acdd-4789-b856-e3cedb0302f6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:47.016964 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-21eab0ce-acdd-4789-b856-e3cedb0302f6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:47.018286 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-21eab0ce-acdd-4789-b856-e3cedb0302f6 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.427750 Aug 08 17:01:47.019428 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 582/1158] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:46 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:47.053989 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-915f4290-3064-476b-b5c9-b9600c9bb339 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:47.062869 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-915f4290-3064-476b-b5c9-b9600c9bb339 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.538741 Aug 08 17:01:47.063966 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 577/1159] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:46 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:48.061600 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2fa9b70e-59bb-4a93-a897-3ff578182a4a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:48.061600 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2fa9b70e-59bb-4a93-a897-3ff578182a4a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:48.061600 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2fa9b70e-59bb-4a93-a897-3ff578182a4a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:48.061600 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2fa9b70e-59bb-4a93-a897-3ff578182a4a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:48.062767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2fa9b70e-59bb-4a93-a897-3ff578182a4a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:48.062767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2fa9b70e-59bb-4a93-a897-3ff578182a4a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:48.062767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2fa9b70e-59bb-4a93-a897-3ff578182a4a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:48.062767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2fa9b70e-59bb-4a93-a897-3ff578182a4a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:48.087033 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-453855bc-43ff-42a5-ab4d-83c28f15ad70 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:48.087647 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-453855bc-43ff-42a5-ab4d-83c28f15ad70 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:48.098385 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-453855bc-43ff-42a5-ab4d-83c28f15ad70 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:48.099183 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-453855bc-43ff-42a5-ab4d-83c28f15ad70 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:48.099830 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-453855bc-43ff-42a5-ab4d-83c28f15ad70 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:48.100621 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-453855bc-43ff-42a5-ab4d-83c28f15ad70 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:48.101076 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-453855bc-43ff-42a5-ab4d-83c28f15ad70 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:48.101500 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-453855bc-43ff-42a5-ab4d-83c28f15ad70 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:48.208526 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2fa9b70e-59bb-4a93-a897-3ff578182a4a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:48.227607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2fa9b70e-59bb-4a93-a897-3ff578182a4a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:48.230756 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2fa9b70e-59bb-4a93-a897-3ff578182a4a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:48.232513 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2fa9b70e-59bb-4a93-a897-3ff578182a4a tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1729 microversion: 2.20 time: 0.194945 Aug 08 17:01:48.238020 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 583/1160] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:48 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:48.302006 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-453855bc-43ff-42a5-ab4d-83c28f15ad70 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:48.311354 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-453855bc-43ff-42a5-ab4d-83c28f15ad70 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.229354 Aug 08 17:01:48.315101 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 578/1161] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:48 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:49.263309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-21481abd-197e-42e9-af4c-42bb2272e8f2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:49.263935 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-21481abd-197e-42e9-af4c-42bb2272e8f2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:49.270718 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-21481abd-197e-42e9-af4c-42bb2272e8f2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:49.271203 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-21481abd-197e-42e9-af4c-42bb2272e8f2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:49.271632 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-21481abd-197e-42e9-af4c-42bb2272e8f2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:49.272330 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-21481abd-197e-42e9-af4c-42bb2272e8f2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:49.272754 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-21481abd-197e-42e9-af4c-42bb2272e8f2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:49.273240 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-21481abd-197e-42e9-af4c-42bb2272e8f2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:49.334223 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-36958c0a-7348-4407-9787-4773c52ae110 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:49.339153 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-36958c0a-7348-4407-9787-4773c52ae110 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:49.347536 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-36958c0a-7348-4407-9787-4773c52ae110 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:49.348298 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-36958c0a-7348-4407-9787-4773c52ae110 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:49.348950 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-36958c0a-7348-4407-9787-4773c52ae110 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:49.350872 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-36958c0a-7348-4407-9787-4773c52ae110 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:49.351459 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-36958c0a-7348-4407-9787-4773c52ae110 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:49.352438 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-36958c0a-7348-4407-9787-4773c52ae110 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:49.462850 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-21481abd-197e-42e9-af4c-42bb2272e8f2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:49.472037 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-21481abd-197e-42e9-af4c-42bb2272e8f2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:49.473681 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-21481abd-197e-42e9-af4c-42bb2272e8f2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:49.474913 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-21481abd-197e-42e9-af4c-42bb2272e8f2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1716 microversion: 2.20 time: 0.215500 Aug 08 17:01:49.475844 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 584/1162] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:01:49 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1716 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:01:49.577422 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-36958c0a-7348-4407-9787-4773c52ae110 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:49.586156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-36958c0a-7348-4407-9787-4773c52ae110 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1508 microversion: 2.1 time: 0.256123 Aug 08 17:01:49.595261 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 579/1163] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:49 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:49.614179 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a4e31efb-04b0-4658-9623-877792f734da tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:49.614865 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a4e31efb-04b0-4658-9623-877792f734da tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:49.621124 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4e31efb-04b0-4658-9623-877792f734da tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:49.622932 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4e31efb-04b0-4658-9623-877792f734da tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:49.622932 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4e31efb-04b0-4658-9623-877792f734da tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:49.622932 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4e31efb-04b0-4658-9623-877792f734da tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:49.623437 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4e31efb-04b0-4658-9623-877792f734da tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:49.623941 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4e31efb-04b0-4658-9623-877792f734da tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:49.668993 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a4e31efb-04b0-4658-9623-877792f734da tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130236) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 17:01:49.954341 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a4e31efb-04b0-4658-9623-877792f734da tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "POST /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748/action" status: 202 len: 0 microversion: 2.1 time: 0.345053 Aug 08 17:01:49.967985 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e9b36c1f-ebf3-4007-8685-a36cf54035c4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:49.969363 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e9b36c1f-ebf3-4007-8685-a36cf54035c4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:49.969460 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 585/1164] 10.222.0.13 () {60 vars in 1278 bytes} [Mon Aug 8 17:01:49 2022] POST /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 17:01:49.982031 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e9b36c1f-ebf3-4007-8685-a36cf54035c4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:49.982031 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e9b36c1f-ebf3-4007-8685-a36cf54035c4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:49.982031 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e9b36c1f-ebf3-4007-8685-a36cf54035c4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:49.982031 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e9b36c1f-ebf3-4007-8685-a36cf54035c4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:49.982369 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e9b36c1f-ebf3-4007-8685-a36cf54035c4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:49.982369 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e9b36c1f-ebf3-4007-8685-a36cf54035c4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:50.133803 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e9b36c1f-ebf3-4007-8685-a36cf54035c4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:50.145234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e9b36c1f-ebf3-4007-8685-a36cf54035c4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1516 microversion: 2.1 time: 0.184963 Aug 08 17:01:50.145925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 580/1165] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:49 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:51.168414 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3b31c1fb-4b11-4fc7-be0c-027fed38f79e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:51.169021 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3b31c1fb-4b11-4fc7-be0c-027fed38f79e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:51.171132 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:51.176131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3b31c1fb-4b11-4fc7-be0c-027fed38f79e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:51.176610 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3b31c1fb-4b11-4fc7-be0c-027fed38f79e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:51.177044 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3b31c1fb-4b11-4fc7-be0c-027fed38f79e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:51.177732 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3b31c1fb-4b11-4fc7-be0c-027fed38f79e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:51.178419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3b31c1fb-4b11-4fc7-be0c-027fed38f79e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:51.178619 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3b31c1fb-4b11-4fc7-be0c-027fed38f79e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:51.318143 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3b31c1fb-4b11-4fc7-be0c-027fed38f79e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:51.326962 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3b31c1fb-4b11-4fc7-be0c-027fed38f79e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1516 microversion: 2.1 time: 0.162663 Aug 08 17:01:51.328639 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 586/1166] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:51 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:51.748596 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-c2e4c446-c168-46d1-84ec-f2682be30d26 req-147b7338-baa0-461d-87d0-23c58c4148e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff2191f-71f9-44b6-ae73-7e7385c80748", "name": "network-vif-unplugged", "status": "completed", "tag": "c2eba598-5d72-4cf8-b348-8af93d348bb8"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:51.760367 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-c2e4c446-c168-46d1-84ec-f2682be30d26 req-147b7338-baa0-461d-87d0-23c58c4148e0 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:51.762294 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-c2e4c446-c168-46d1-84ec-f2682be30d26 req-147b7338-baa0-461d-87d0-23c58c4148e0 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:51.762294 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-c2e4c446-c168-46d1-84ec-f2682be30d26 req-147b7338-baa0-461d-87d0-23c58c4148e0 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:51.774387 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.compute.server_external_events [req-c2e4c446-c168-46d1-84ec-f2682be30d26 req-147b7338-baa0-461d-87d0-23c58c4148e0 service nova] Unable to find a host for instance eff2191f-71f9-44b6-ae73-7e7385c80748. Dropping event network-vif-unplugged {{(pid=130235) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 08 17:01:51.775321 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-c2e4c446-c168-46d1-84ec-f2682be30d26 req-147b7338-baa0-461d-87d0-23c58c4148e0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030713 Aug 08 17:01:51.775928 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 581/1167] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 08 17:01:52.349694 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-11cadc17-2df6-4284-8059-2ed69e9e3f51 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:52.350361 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-11cadc17-2df6-4284-8059-2ed69e9e3f51 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:52.358337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-11cadc17-2df6-4284-8059-2ed69e9e3f51 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:52.359792 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-11cadc17-2df6-4284-8059-2ed69e9e3f51 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:52.360337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-11cadc17-2df6-4284-8059-2ed69e9e3f51 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:52.361101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-11cadc17-2df6-4284-8059-2ed69e9e3f51 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:52.361725 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-11cadc17-2df6-4284-8059-2ed69e9e3f51 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:52.362340 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-11cadc17-2df6-4284-8059-2ed69e9e3f51 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:52.522350 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-11cadc17-2df6-4284-8059-2ed69e9e3f51 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:52.527424 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:52.531982 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-11cadc17-2df6-4284-8059-2ed69e9e3f51 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1518 microversion: 2.1 time: 0.187026 Aug 08 17:01:52.532575 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 587/1168] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:52 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:52.940703 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1116025328", "imageRef": "e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604", "flavorRef": "452"}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:53.020983 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.network.neutron [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] validate_networks() for None {{(pid=130235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:01:53.348456 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Flavor limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:01:53.348916 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Image limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:01:53.349387 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Flavor pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:01:53.349853 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Image pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:01:53.350261 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:01:53.360428 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:53.360795 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:53.361233 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:53.361970 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:53.362419 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:53.362870 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:53.382119 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Getting quotas for project 4fb2e613a7774f0291ba9cccc18cfb31. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:01:53.386489 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Getting quotas for user eda9c43329f54e19bead646695ba29d2 and project 4fb2e613a7774f0291ba9cccc18cfb31. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:01:53.397676 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Going to run 1 instances... {{(pid=130235) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:01:53.400053 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5488d2d-e4f7-42c7-9ab3-8cfc5a5ee604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:01:53.557719 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d62daf9b-8675-4b0f-9eb1-9a7865d2e5af tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:53.557719 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d62daf9b-8675-4b0f-9eb1-9a7865d2e5af tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:53.561583 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-838bf138-7cbf-4739-8181-37fd161e2f03 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626292 Aug 08 17:01:53.568789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 582/1169] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 17:01:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:01:53.577656 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1f399946-13e5-4a11-bceb-13997e6fb5f6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:53.579047 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1f399946-13e5-4a11-bceb-13997e6fb5f6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:53.586877 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d62daf9b-8675-4b0f-9eb1-9a7865d2e5af tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:53.587366 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d62daf9b-8675-4b0f-9eb1-9a7865d2e5af tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:53.587805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d62daf9b-8675-4b0f-9eb1-9a7865d2e5af tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:53.593573 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d62daf9b-8675-4b0f-9eb1-9a7865d2e5af tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:53.594068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d62daf9b-8675-4b0f-9eb1-9a7865d2e5af tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:53.594770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d62daf9b-8675-4b0f-9eb1-9a7865d2e5af tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:53.650031 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1f399946-13e5-4a11-bceb-13997e6fb5f6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:53.658186 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1f399946-13e5-4a11-bceb-13997e6fb5f6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1215 microversion: 2.1 time: 0.086339 Aug 08 17:01:53.659826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 583/1170] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:53 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:53.789163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d62daf9b-8675-4b0f-9eb1-9a7865d2e5af tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:53.797186 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d62daf9b-8675-4b0f-9eb1-9a7865d2e5af tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.246103 Aug 08 17:01:53.797827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 588/1171] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:53 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:54.678745 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-53c1b388-e041-4296-b963-6cfd1b5c6dbc tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:54.679418 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-53c1b388-e041-4296-b963-6cfd1b5c6dbc tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:54.734506 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-53c1b388-e041-4296-b963-6cfd1b5c6dbc tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:54.742100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-53c1b388-e041-4296-b963-6cfd1b5c6dbc tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1215 microversion: 2.1 time: 0.067278 Aug 08 17:01:54.742717 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 584/1172] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:54 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:54.832528 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-177ad591-9c90-45bd-82fb-c3a56e896ba3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:54.833146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-177ad591-9c90-45bd-82fb-c3a56e896ba3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:54.840145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-177ad591-9c90-45bd-82fb-c3a56e896ba3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:54.840694 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-177ad591-9c90-45bd-82fb-c3a56e896ba3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:54.841202 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-177ad591-9c90-45bd-82fb-c3a56e896ba3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:54.841902 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-177ad591-9c90-45bd-82fb-c3a56e896ba3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:54.842353 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-177ad591-9c90-45bd-82fb-c3a56e896ba3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:54.842849 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-177ad591-9c90-45bd-82fb-c3a56e896ba3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:55.001735 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-177ad591-9c90-45bd-82fb-c3a56e896ba3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:55.009769 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-177ad591-9c90-45bd-82fb-c3a56e896ba3 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.181031 Aug 08 17:01:55.010361 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 589/1173] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:54 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:55.763691 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-02e840cf-b043-4afe-a103-a86056f5221e tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:55.764269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-02e840cf-b043-4afe-a103-a86056f5221e tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:55.772190 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-02e840cf-b043-4afe-a103-a86056f5221e tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:55.772672 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-02e840cf-b043-4afe-a103-a86056f5221e tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:55.773111 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-02e840cf-b043-4afe-a103-a86056f5221e tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:55.773809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-02e840cf-b043-4afe-a103-a86056f5221e tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:55.774265 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-02e840cf-b043-4afe-a103-a86056f5221e tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:55.774843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-02e840cf-b043-4afe-a103-a86056f5221e tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:55.840403 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-02e840cf-b043-4afe-a103-a86056f5221e tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:55.849065 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-02e840cf-b043-4afe-a103-a86056f5221e tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1267 microversion: 2.1 time: 0.089492 Aug 08 17:01:55.849653 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 585/1174] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:55 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:56.032400 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-523304a0-641b-4e9c-aad0-3e8ffe56a144 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:56.033125 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-523304a0-641b-4e9c-aad0-3e8ffe56a144 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:56.039759 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-523304a0-641b-4e9c-aad0-3e8ffe56a144 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:56.040254 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-523304a0-641b-4e9c-aad0-3e8ffe56a144 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:56.040705 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-523304a0-641b-4e9c-aad0-3e8ffe56a144 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:56.041412 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-523304a0-641b-4e9c-aad0-3e8ffe56a144 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:56.041884 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-523304a0-641b-4e9c-aad0-3e8ffe56a144 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:56.042318 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-523304a0-641b-4e9c-aad0-3e8ffe56a144 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:56.183618 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-523304a0-641b-4e9c-aad0-3e8ffe56a144 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:56.192621 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-523304a0-641b-4e9c-aad0-3e8ffe56a144 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.164880 Aug 08 17:01:56.193296 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 590/1175] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:56 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:56.874045 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-327c05d8-56fc-488a-b5eb-33db45782634 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:56.875381 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-327c05d8-56fc-488a-b5eb-33db45782634 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:56.882428 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-327c05d8-56fc-488a-b5eb-33db45782634 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:56.882954 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-327c05d8-56fc-488a-b5eb-33db45782634 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:56.883386 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-327c05d8-56fc-488a-b5eb-33db45782634 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:56.884116 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-327c05d8-56fc-488a-b5eb-33db45782634 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:56.884565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-327c05d8-56fc-488a-b5eb-33db45782634 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:56.884983 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-327c05d8-56fc-488a-b5eb-33db45782634 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:56.959750 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-327c05d8-56fc-488a-b5eb-33db45782634 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:56.969544 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-327c05d8-56fc-488a-b5eb-33db45782634 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1285 microversion: 2.1 time: 0.099983 Aug 08 17:01:56.983064 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 586/1176] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:56 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:57.215535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f82c9869-aa36-4067-9bde-910ef909c733 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:57.216132 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f82c9869-aa36-4067-9bde-910ef909c733 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:57.223874 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f82c9869-aa36-4067-9bde-910ef909c733 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:57.226052 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f82c9869-aa36-4067-9bde-910ef909c733 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:57.226052 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f82c9869-aa36-4067-9bde-910ef909c733 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:57.226052 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f82c9869-aa36-4067-9bde-910ef909c733 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:57.226052 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f82c9869-aa36-4067-9bde-910ef909c733 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:57.226450 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f82c9869-aa36-4067-9bde-910ef909c733 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:57.377403 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-f82c9869-aa36-4067-9bde-910ef909c733 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:57.385435 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f82c9869-aa36-4067-9bde-910ef909c733 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.174090 Aug 08 17:01:57.386024 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 591/1177] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:57 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:57.991705 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-49fb70a5-18ae-41dc-974c-b0057ecf2676 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:57.992407 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-49fb70a5-18ae-41dc-974c-b0057ecf2676 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:57.999626 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-49fb70a5-18ae-41dc-974c-b0057ecf2676 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:57.999875 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-49fb70a5-18ae-41dc-974c-b0057ecf2676 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:58.000314 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-49fb70a5-18ae-41dc-974c-b0057ecf2676 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:58.001225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-49fb70a5-18ae-41dc-974c-b0057ecf2676 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:58.001866 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-49fb70a5-18ae-41dc-974c-b0057ecf2676 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:58.002301 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-49fb70a5-18ae-41dc-974c-b0057ecf2676 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:58.232416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-49fb70a5-18ae-41dc-974c-b0057ecf2676 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:58.242413 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-49fb70a5-18ae-41dc-974c-b0057ecf2676 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.254925 Aug 08 17:01:58.243794 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 587/1178] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:57 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:01:58.408597 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-3f3f57aa-34e0-4f54-8325-51bfa215071d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:58.409248 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-3f3f57aa-34e0-4f54-8325-51bfa215071d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:58.415519 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3f3f57aa-34e0-4f54-8325-51bfa215071d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:58.415968 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3f3f57aa-34e0-4f54-8325-51bfa215071d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:58.416573 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3f3f57aa-34e0-4f54-8325-51bfa215071d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:58.417304 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3f3f57aa-34e0-4f54-8325-51bfa215071d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:58.417738 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3f3f57aa-34e0-4f54-8325-51bfa215071d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:58.418168 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-3f3f57aa-34e0-4f54-8325-51bfa215071d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:58.505301 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-d8f68151-20a7-49c9-884f-ba121a54aa5b req-1675011f-9436-439b-94d1-88c9a0ccfc46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c9e039-3f1c-4c52-bd66-957b42657e7d", "tag": "185e4b79-6619-43bb-bfcd-1cdaf7e901db"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:01:58.527922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-d8f68151-20a7-49c9-884f-ba121a54aa5b req-1675011f-9436-439b-94d1-88c9a0ccfc46 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:58.528803 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-d8f68151-20a7-49c9-884f-ba121a54aa5b req-1675011f-9436-439b-94d1-88c9a0ccfc46 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:58.529716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-d8f68151-20a7-49c9-884f-ba121a54aa5b req-1675011f-9436-439b-94d1-88c9a0ccfc46 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:58.554233 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-d8f68151-20a7-49c9-884f-ba121a54aa5b req-1675011f-9436-439b-94d1-88c9a0ccfc46 service nova] Creating event network-changed:185e4b79-6619-43bb-bfcd-1cdaf7e901db for instance f2c9e039-3f1c-4c52-bd66-957b42657e7d on hv-cinder-85220 Aug 08 17:01:58.568082 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-d8f68151-20a7-49c9-884f-ba121a54aa5b req-1675011f-9436-439b-94d1-88c9a0ccfc46 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072945 Aug 08 17:01:58.569925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 588/1179] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:01:58.589096 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-3f3f57aa-34e0-4f54-8325-51bfa215071d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:58.601003 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-3f3f57aa-34e0-4f54-8325-51bfa215071d tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.197899 Aug 08 17:01:58.601605 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 592/1180] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:58 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:59.268486 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-bfa72cbf-7203-4684-bcb6-21ad5a470101 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:59.269237 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-bfa72cbf-7203-4684-bcb6-21ad5a470101 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:59.276232 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bfa72cbf-7203-4684-bcb6-21ad5a470101 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:59.276733 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bfa72cbf-7203-4684-bcb6-21ad5a470101 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:59.277177 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bfa72cbf-7203-4684-bcb6-21ad5a470101 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:59.277891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bfa72cbf-7203-4684-bcb6-21ad5a470101 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:59.278374 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bfa72cbf-7203-4684-bcb6-21ad5a470101 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:59.279000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-bfa72cbf-7203-4684-bcb6-21ad5a470101 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:59.470738 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-bfa72cbf-7203-4684-bcb6-21ad5a470101 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:59.473256 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=100 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:01:59.480143 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-bfa72cbf-7203-4684-bcb6-21ad5a470101 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.217612 Aug 08 17:01:59.480908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 589/1181] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:59 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:01:59.627159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e31156e8-59e5-48c1-b8fb-8ac70bf04c48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:01:59.628358 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e31156e8-59e5-48c1-b8fb-8ac70bf04c48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:01:59.636336 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e31156e8-59e5-48c1-b8fb-8ac70bf04c48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:59.636953 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e31156e8-59e5-48c1-b8fb-8ac70bf04c48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:59.637504 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e31156e8-59e5-48c1-b8fb-8ac70bf04c48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:59.638403 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e31156e8-59e5-48c1-b8fb-8ac70bf04c48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:01:59.639133 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e31156e8-59e5-48c1-b8fb-8ac70bf04c48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:01:59.639840 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e31156e8-59e5-48c1-b8fb-8ac70bf04c48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:01:59.795481 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e31156e8-59e5-48c1-b8fb-8ac70bf04c48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:01:59.804831 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e31156e8-59e5-48c1-b8fb-8ac70bf04c48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.184318 Aug 08 17:01:59.806158 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 593/1182] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:01:59 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:00.502004 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e02ac4df-908b-40a6-af68-9ece362517ec tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:00.502759 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e02ac4df-908b-40a6-af68-9ece362517ec tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:00.509851 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e02ac4df-908b-40a6-af68-9ece362517ec tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:00.510428 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e02ac4df-908b-40a6-af68-9ece362517ec tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:00.510965 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e02ac4df-908b-40a6-af68-9ece362517ec tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:00.511766 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e02ac4df-908b-40a6-af68-9ece362517ec tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:00.512303 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e02ac4df-908b-40a6-af68-9ece362517ec tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:00.512803 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e02ac4df-908b-40a6-af68-9ece362517ec tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:00.654178 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e02ac4df-908b-40a6-af68-9ece362517ec tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:00.662267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e02ac4df-908b-40a6-af68-9ece362517ec tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.164541 Aug 08 17:02:00.668638 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 590/1183] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:00 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:00.845530 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7ac4ca55-dc4f-4063-b195-fac9c79f76f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:00.846162 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7ac4ca55-dc4f-4063-b195-fac9c79f76f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:00.852764 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7ac4ca55-dc4f-4063-b195-fac9c79f76f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:00.853256 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7ac4ca55-dc4f-4063-b195-fac9c79f76f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:00.853694 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7ac4ca55-dc4f-4063-b195-fac9c79f76f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:00.854421 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7ac4ca55-dc4f-4063-b195-fac9c79f76f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:00.854900 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7ac4ca55-dc4f-4063-b195-fac9c79f76f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:00.855331 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7ac4ca55-dc4f-4063-b195-fac9c79f76f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:00.996182 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7ac4ca55-dc4f-4063-b195-fac9c79f76f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:01.005861 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7ac4ca55-dc4f-4063-b195-fac9c79f76f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.166515 Aug 08 17:02:01.006453 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 594/1184] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:00 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:01.684185 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f558f61e-4733-4916-a40c-b6d5758db060 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:01.684797 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f558f61e-4733-4916-a40c-b6d5758db060 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:01.691897 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f558f61e-4733-4916-a40c-b6d5758db060 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:01.692378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f558f61e-4733-4916-a40c-b6d5758db060 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:01.692813 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f558f61e-4733-4916-a40c-b6d5758db060 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:01.693516 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f558f61e-4733-4916-a40c-b6d5758db060 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:01.693966 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f558f61e-4733-4916-a40c-b6d5758db060 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:01.694386 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f558f61e-4733-4916-a40c-b6d5758db060 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:01.916605 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f558f61e-4733-4916-a40c-b6d5758db060 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:01.930048 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f558f61e-4733-4916-a40c-b6d5758db060 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.249638 Aug 08 17:02:01.945955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 591/1185] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:01 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:02.027601 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-073001e9-6e4d-48f1-b427-f239bb824098 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:02.028326 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-073001e9-6e4d-48f1-b427-f239bb824098 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:02.036389 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-073001e9-6e4d-48f1-b427-f239bb824098 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:02.036858 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-073001e9-6e4d-48f1-b427-f239bb824098 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:02.037512 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-073001e9-6e4d-48f1-b427-f239bb824098 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:02.038223 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-073001e9-6e4d-48f1-b427-f239bb824098 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:02.038727 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-073001e9-6e4d-48f1-b427-f239bb824098 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:02.039152 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-073001e9-6e4d-48f1-b427-f239bb824098 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:02.202466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-073001e9-6e4d-48f1-b427-f239bb824098 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:02.215427 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-073001e9-6e4d-48f1-b427-f239bb824098 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.191672 Aug 08 17:02:02.216220 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 595/1186] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:02 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:02.952818 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-09f20c1c-6365-4341-8b0c-2b4c65de486d tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:02.953437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-09f20c1c-6365-4341-8b0c-2b4c65de486d tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:02.960255 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-09f20c1c-6365-4341-8b0c-2b4c65de486d tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:02.960744 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-09f20c1c-6365-4341-8b0c-2b4c65de486d tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:02.961180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-09f20c1c-6365-4341-8b0c-2b4c65de486d tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:02.961881 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-09f20c1c-6365-4341-8b0c-2b4c65de486d tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:02.962328 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-09f20c1c-6365-4341-8b0c-2b4c65de486d tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:02.962786 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-09f20c1c-6365-4341-8b0c-2b4c65de486d tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:03.100074 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-09f20c1c-6365-4341-8b0c-2b4c65de486d tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:03.107692 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-09f20c1c-6365-4341-8b0c-2b4c65de486d tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.159415 Aug 08 17:02:03.108747 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 592/1187] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:02 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:03.241345 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-0fcee556-98dc-4b1e-92a6-df42ee4159e6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:03.241968 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-0fcee556-98dc-4b1e-92a6-df42ee4159e6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:03.248753 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fcee556-98dc-4b1e-92a6-df42ee4159e6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:03.250029 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fcee556-98dc-4b1e-92a6-df42ee4159e6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:03.250595 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fcee556-98dc-4b1e-92a6-df42ee4159e6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:03.251364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fcee556-98dc-4b1e-92a6-df42ee4159e6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:03.251823 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fcee556-98dc-4b1e-92a6-df42ee4159e6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:03.252258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-0fcee556-98dc-4b1e-92a6-df42ee4159e6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:03.389591 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-0fcee556-98dc-4b1e-92a6-df42ee4159e6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:03.397398 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-0fcee556-98dc-4b1e-92a6-df42ee4159e6 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.160151 Aug 08 17:02:03.397976 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 596/1188] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:03 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:04.129936 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-12e4378a-6a4a-43e0-b5d8-50faab013623 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:04.130642 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-12e4378a-6a4a-43e0-b5d8-50faab013623 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:04.132734 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:04.138098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-12e4378a-6a4a-43e0-b5d8-50faab013623 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:04.138660 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-12e4378a-6a4a-43e0-b5d8-50faab013623 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:04.139116 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-12e4378a-6a4a-43e0-b5d8-50faab013623 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:04.139813 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-12e4378a-6a4a-43e0-b5d8-50faab013623 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:04.140263 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-12e4378a-6a4a-43e0-b5d8-50faab013623 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:04.141614 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-12e4378a-6a4a-43e0-b5d8-50faab013623 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:04.287867 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-12e4378a-6a4a-43e0-b5d8-50faab013623 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:04.295868 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-12e4378a-6a4a-43e0-b5d8-50faab013623 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.170062 Aug 08 17:02:04.296455 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 593/1189] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:04 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:04.337944 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:02:04.338188 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Mon Aug 8 17:02:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:02:04.419467 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2133b587-dd3f-45fb-9451-5ae08109bde7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:04.420080 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2133b587-dd3f-45fb-9451-5ae08109bde7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:04.427250 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2133b587-dd3f-45fb-9451-5ae08109bde7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:04.427732 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2133b587-dd3f-45fb-9451-5ae08109bde7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:04.428168 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2133b587-dd3f-45fb-9451-5ae08109bde7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:04.428871 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2133b587-dd3f-45fb-9451-5ae08109bde7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:04.429319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2133b587-dd3f-45fb-9451-5ae08109bde7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:04.429810 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2133b587-dd3f-45fb-9451-5ae08109bde7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:04.582690 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2133b587-dd3f-45fb-9451-5ae08109bde7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:04.590499 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2133b587-dd3f-45fb-9451-5ae08109bde7 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.174922 Aug 08 17:02:04.591094 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 597/1190] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:04 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:05.321517 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-25b080a7-8046-4360-8e8f-2e371e9f09ee tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:05.322558 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-25b080a7-8046-4360-8e8f-2e371e9f09ee tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:05.325951 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=10 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:05.340272 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-25b080a7-8046-4360-8e8f-2e371e9f09ee tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:05.341161 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-25b080a7-8046-4360-8e8f-2e371e9f09ee tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:05.341963 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-25b080a7-8046-4360-8e8f-2e371e9f09ee tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:05.343307 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-25b080a7-8046-4360-8e8f-2e371e9f09ee tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:05.344741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-25b080a7-8046-4360-8e8f-2e371e9f09ee tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:05.345547 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-25b080a7-8046-4360-8e8f-2e371e9f09ee tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:05.507199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-25b080a7-8046-4360-8e8f-2e371e9f09ee tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:05.521182 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-25b080a7-8046-4360-8e8f-2e371e9f09ee tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.206803 Aug 08 17:02:05.522175 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 594/1191] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:05 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:05.613104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-d382e3d9-19a6-47ca-90ab-dfd7d6549566 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:05.613727 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-d382e3d9-19a6-47ca-90ab-dfd7d6549566 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:05.620522 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d382e3d9-19a6-47ca-90ab-dfd7d6549566 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:05.621005 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d382e3d9-19a6-47ca-90ab-dfd7d6549566 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:05.621439 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d382e3d9-19a6-47ca-90ab-dfd7d6549566 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:05.622152 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d382e3d9-19a6-47ca-90ab-dfd7d6549566 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:05.622625 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d382e3d9-19a6-47ca-90ab-dfd7d6549566 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:05.623083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-d382e3d9-19a6-47ca-90ab-dfd7d6549566 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:05.791377 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-d382e3d9-19a6-47ca-90ab-dfd7d6549566 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:05.804410 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-d382e3d9-19a6-47ca-90ab-dfd7d6549566 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.195663 Aug 08 17:02:05.805363 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 598/1192] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:05 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:06.316186 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-f09733d9-3108-411b-bc50-df6b2b117255 req-6e4a4dd4-4856-473b-95ba-8e04cec296aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff2191f-71f9-44b6-ae73-7e7385c80748", "name": "network-vif-plugged", "status": "completed", "tag": "c2eba598-5d72-4cf8-b348-8af93d348bb8"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:06.326075 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-f09733d9-3108-411b-bc50-df6b2b117255 req-6e4a4dd4-4856-473b-95ba-8e04cec296aa service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:06.326829 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-f09733d9-3108-411b-bc50-df6b2b117255 req-6e4a4dd4-4856-473b-95ba-8e04cec296aa service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:06.326986 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-f09733d9-3108-411b-bc50-df6b2b117255 req-6e4a4dd4-4856-473b-95ba-8e04cec296aa service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:06.339806 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-f09733d9-3108-411b-bc50-df6b2b117255 req-6e4a4dd4-4856-473b-95ba-8e04cec296aa service nova] Creating event network-vif-plugged:c2eba598-5d72-4cf8-b348-8af93d348bb8 for instance eff2191f-71f9-44b6-ae73-7e7385c80748 on hv-cinder-85220 Aug 08 17:02:06.345321 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-f09733d9-3108-411b-bc50-df6b2b117255 req-6e4a4dd4-4856-473b-95ba-8e04cec296aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038075 Aug 08 17:02:06.345973 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 595/1193] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:02:06.546357 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fdc385d1-7355-4881-b4eb-a764c702a50f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:06.547607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fdc385d1-7355-4881-b4eb-a764c702a50f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:06.554297 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fdc385d1-7355-4881-b4eb-a764c702a50f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:06.555014 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fdc385d1-7355-4881-b4eb-a764c702a50f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:06.555841 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fdc385d1-7355-4881-b4eb-a764c702a50f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:06.556646 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fdc385d1-7355-4881-b4eb-a764c702a50f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:06.557099 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fdc385d1-7355-4881-b4eb-a764c702a50f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:06.557791 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fdc385d1-7355-4881-b4eb-a764c702a50f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:06.758832 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fdc385d1-7355-4881-b4eb-a764c702a50f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:06.777332 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fdc385d1-7355-4881-b4eb-a764c702a50f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.237843 Aug 08 17:02:06.778095 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 599/1194] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:06 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:06.827655 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2b2d4140-fa41-4f45-bac8-60475763319c tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:06.829372 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2b2d4140-fa41-4f45-bac8-60475763319c tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:06.835921 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2b2d4140-fa41-4f45-bac8-60475763319c tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:06.836440 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2b2d4140-fa41-4f45-bac8-60475763319c tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:06.837100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2b2d4140-fa41-4f45-bac8-60475763319c tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:06.837827 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2b2d4140-fa41-4f45-bac8-60475763319c tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:06.838455 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2b2d4140-fa41-4f45-bac8-60475763319c tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:06.839091 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2b2d4140-fa41-4f45-bac8-60475763319c tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:07.268612 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2b2d4140-fa41-4f45-bac8-60475763319c tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:07.277763 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2b2d4140-fa41-4f45-bac8-60475763319c tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.455267 Aug 08 17:02:07.278717 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 596/1195] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:06 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:07.811912 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e1dfb0b0-6dea-4d15-a3fa-9e66bef4e812 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:07.812564 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e1dfb0b0-6dea-4d15-a3fa-9e66bef4e812 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:07.819962 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e1dfb0b0-6dea-4d15-a3fa-9e66bef4e812 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:07.820463 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e1dfb0b0-6dea-4d15-a3fa-9e66bef4e812 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:07.820908 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e1dfb0b0-6dea-4d15-a3fa-9e66bef4e812 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:07.821630 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e1dfb0b0-6dea-4d15-a3fa-9e66bef4e812 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:07.822142 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e1dfb0b0-6dea-4d15-a3fa-9e66bef4e812 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:07.822603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e1dfb0b0-6dea-4d15-a3fa-9e66bef4e812 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:08.026992 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e1dfb0b0-6dea-4d15-a3fa-9e66bef4e812 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:08.036423 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e1dfb0b0-6dea-4d15-a3fa-9e66bef4e812 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.228877 Aug 08 17:02:08.036928 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 600/1196] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:07 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:08.317467 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-292547d1-18e8-4bfe-8830-fcfdd2ee549f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:08.319770 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-292547d1-18e8-4bfe-8830-fcfdd2ee549f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:08.332561 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-292547d1-18e8-4bfe-8830-fcfdd2ee549f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:08.333190 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-292547d1-18e8-4bfe-8830-fcfdd2ee549f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:08.334476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-292547d1-18e8-4bfe-8830-fcfdd2ee549f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:08.335732 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-292547d1-18e8-4bfe-8830-fcfdd2ee549f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:08.336590 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-292547d1-18e8-4bfe-8830-fcfdd2ee549f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:08.337342 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-292547d1-18e8-4bfe-8830-fcfdd2ee549f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:08.516826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-292547d1-18e8-4bfe-8830-fcfdd2ee549f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:08.525721 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-292547d1-18e8-4bfe-8830-fcfdd2ee549f tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.216373 Aug 08 17:02:08.526421 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 597/1197] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:08 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:09.058773 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4bd131fe-fbd7-4ff6-9d33-115c18f5324f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:09.059404 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4bd131fe-fbd7-4ff6-9d33-115c18f5324f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:09.067015 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4bd131fe-fbd7-4ff6-9d33-115c18f5324f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:09.067510 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4bd131fe-fbd7-4ff6-9d33-115c18f5324f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:09.068101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4bd131fe-fbd7-4ff6-9d33-115c18f5324f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:09.068817 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4bd131fe-fbd7-4ff6-9d33-115c18f5324f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:09.069337 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4bd131fe-fbd7-4ff6-9d33-115c18f5324f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:09.069778 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4bd131fe-fbd7-4ff6-9d33-115c18f5324f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:09.215752 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4bd131fe-fbd7-4ff6-9d33-115c18f5324f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:09.224771 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4bd131fe-fbd7-4ff6-9d33-115c18f5324f tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.170360 Aug 08 17:02:09.225359 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 601/1198] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:09 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:09.548517 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3bc00a16-c0f7-47c1-a387-f249a575083b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:09.549092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-3bc00a16-c0f7-47c1-a387-f249a575083b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:09.556004 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3bc00a16-c0f7-47c1-a387-f249a575083b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:09.556498 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3bc00a16-c0f7-47c1-a387-f249a575083b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:09.556939 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3bc00a16-c0f7-47c1-a387-f249a575083b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:09.557652 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3bc00a16-c0f7-47c1-a387-f249a575083b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:09.558109 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3bc00a16-c0f7-47c1-a387-f249a575083b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:09.558537 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3bc00a16-c0f7-47c1-a387-f249a575083b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:09.705475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-3bc00a16-c0f7-47c1-a387-f249a575083b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:09.713771 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-3bc00a16-c0f7-47c1-a387-f249a575083b tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.169753 Aug 08 17:02:09.714358 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 598/1199] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:09 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:10.245675 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a4aa0c61-49af-426d-a8e1-8d9af97ecb9a tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:10.246546 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a4aa0c61-49af-426d-a8e1-8d9af97ecb9a tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:10.254074 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4aa0c61-49af-426d-a8e1-8d9af97ecb9a tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:10.254593 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4aa0c61-49af-426d-a8e1-8d9af97ecb9a tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:10.255044 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4aa0c61-49af-426d-a8e1-8d9af97ecb9a tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:10.255759 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4aa0c61-49af-426d-a8e1-8d9af97ecb9a tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:10.256210 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4aa0c61-49af-426d-a8e1-8d9af97ecb9a tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:10.256672 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a4aa0c61-49af-426d-a8e1-8d9af97ecb9a tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:10.422219 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a4aa0c61-49af-426d-a8e1-8d9af97ecb9a tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:10.431827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a4aa0c61-49af-426d-a8e1-8d9af97ecb9a tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.190033 Aug 08 17:02:10.432418 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 602/1200] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:10 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:10.736405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7a87678c-9549-4a62-a019-10790a780e6e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:10.736954 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7a87678c-9549-4a62-a019-10790a780e6e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:10.743653 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a87678c-9549-4a62-a019-10790a780e6e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:10.744209 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a87678c-9549-4a62-a019-10790a780e6e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:10.744775 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a87678c-9549-4a62-a019-10790a780e6e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:10.745536 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a87678c-9549-4a62-a019-10790a780e6e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:10.746001 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a87678c-9549-4a62-a019-10790a780e6e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:10.746428 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7a87678c-9549-4a62-a019-10790a780e6e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:10.893255 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-7a87678c-9549-4a62-a019-10790a780e6e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:10.901497 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7a87678c-9549-4a62-a019-10790a780e6e tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1574 microversion: 2.1 time: 0.169919 Aug 08 17:02:10.902256 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 599/1201] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:10 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:11.454783 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-7202d482-b000-4cf8-b022-7f165d83a167 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:11.455422 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-7202d482-b000-4cf8-b022-7f165d83a167 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:11.462167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7202d482-b000-4cf8-b022-7f165d83a167 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:11.462693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7202d482-b000-4cf8-b022-7f165d83a167 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:11.463143 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7202d482-b000-4cf8-b022-7f165d83a167 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:11.463862 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7202d482-b000-4cf8-b022-7f165d83a167 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:11.464333 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7202d482-b000-4cf8-b022-7f165d83a167 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:11.464760 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-7202d482-b000-4cf8-b022-7f165d83a167 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:11.630033 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-7202d482-b000-4cf8-b022-7f165d83a167 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:11.637844 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-7202d482-b000-4cf8-b022-7f165d83a167 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.187115 Aug 08 17:02:11.638429 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 603/1202] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:11 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:11.929061 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-de5f1b9c-ddfb-4e0e-be6f-825bd743f60a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:11.929747 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-de5f1b9c-ddfb-4e0e-be6f-825bd743f60a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:11.931700 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:11.937437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de5f1b9c-ddfb-4e0e-be6f-825bd743f60a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:11.938361 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de5f1b9c-ddfb-4e0e-be6f-825bd743f60a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:11.938949 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de5f1b9c-ddfb-4e0e-be6f-825bd743f60a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:11.939678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de5f1b9c-ddfb-4e0e-be6f-825bd743f60a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:11.940178 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de5f1b9c-ddfb-4e0e-be6f-825bd743f60a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:11.940604 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-de5f1b9c-ddfb-4e0e-be6f-825bd743f60a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:12.104022 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-de5f1b9c-ddfb-4e0e-be6f-825bd743f60a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:12.117173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-de5f1b9c-ddfb-4e0e-be6f-825bd743f60a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1561 microversion: 2.1 time: 0.196513 Aug 08 17:02:12.117751 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 600/1203] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:11 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1561 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:12.659228 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9d897d78-8098-43a0-9d40-506237b200ff tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:12.659856 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9d897d78-8098-43a0-9d40-506237b200ff tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:12.666674 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9d897d78-8098-43a0-9d40-506237b200ff tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:12.667192 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9d897d78-8098-43a0-9d40-506237b200ff tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:12.667702 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9d897d78-8098-43a0-9d40-506237b200ff tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:12.668418 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9d897d78-8098-43a0-9d40-506237b200ff tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:12.668861 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9d897d78-8098-43a0-9d40-506237b200ff tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:12.669280 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9d897d78-8098-43a0-9d40-506237b200ff tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:12.688106 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=100 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:12.816917 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9d897d78-8098-43a0-9d40-506237b200ff tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:12.824558 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9d897d78-8098-43a0-9d40-506237b200ff tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.170007 Aug 08 17:02:12.825459 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 604/1204] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:12 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:13.846956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-d4fa33c4-82e3-4fb4-9466-b3120135c719 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:13.847806 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-d4fa33c4-82e3-4fb4-9466-b3120135c719 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:13.855569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4fa33c4-82e3-4fb4-9466-b3120135c719 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:13.856044 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4fa33c4-82e3-4fb4-9466-b3120135c719 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:13.856478 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4fa33c4-82e3-4fb4-9466-b3120135c719 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:13.857167 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4fa33c4-82e3-4fb4-9466-b3120135c719 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:13.857617 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4fa33c4-82e3-4fb4-9466-b3120135c719 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:13.858032 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-d4fa33c4-82e3-4fb4-9466-b3120135c719 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:14.017303 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-d4fa33c4-82e3-4fb4-9466-b3120135c719 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:14.026492 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-d4fa33c4-82e3-4fb4-9466-b3120135c719 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.183546 Aug 08 17:02:14.027105 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 601/1205] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:13 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:14.391978 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-00ac11f5-efc3-4d15-8b1b-b34a5b5a1d1c req-88550be2-eb29-4504-b741-532a1f722d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c9e039-3f1c-4c52-bd66-957b42657e7d", "name": "network-vif-plugged", "status": "completed", "tag": "185e4b79-6619-43bb-bfcd-1cdaf7e901db"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:14.403875 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-00ac11f5-efc3-4d15-8b1b-b34a5b5a1d1c req-88550be2-eb29-4504-b741-532a1f722d89 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:14.404418 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-00ac11f5-efc3-4d15-8b1b-b34a5b5a1d1c req-88550be2-eb29-4504-b741-532a1f722d89 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:14.404862 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-00ac11f5-efc3-4d15-8b1b-b34a5b5a1d1c req-88550be2-eb29-4504-b741-532a1f722d89 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:14.417277 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-00ac11f5-efc3-4d15-8b1b-b34a5b5a1d1c req-88550be2-eb29-4504-b741-532a1f722d89 service nova] Creating event network-vif-plugged:185e4b79-6619-43bb-bfcd-1cdaf7e901db for instance f2c9e039-3f1c-4c52-bd66-957b42657e7d on hv-cinder-85220 Aug 08 17:02:14.423113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-00ac11f5-efc3-4d15-8b1b-b34a5b5a1d1c req-88550be2-eb29-4504-b741-532a1f722d89 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035769 Aug 08 17:02:14.423839 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 605/1206] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:02:15.050778 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6be8b629-3797-4455-afcb-37e0b31a8b94 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:15.051768 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6be8b629-3797-4455-afcb-37e0b31a8b94 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:15.059075 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6be8b629-3797-4455-afcb-37e0b31a8b94 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:15.059583 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6be8b629-3797-4455-afcb-37e0b31a8b94 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:15.060398 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6be8b629-3797-4455-afcb-37e0b31a8b94 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:15.061119 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6be8b629-3797-4455-afcb-37e0b31a8b94 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:15.061574 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6be8b629-3797-4455-afcb-37e0b31a8b94 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:15.062650 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6be8b629-3797-4455-afcb-37e0b31a8b94 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:15.205922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-6be8b629-3797-4455-afcb-37e0b31a8b94 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:15.213886 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-6be8b629-3797-4455-afcb-37e0b31a8b94 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.168839 Aug 08 17:02:15.214471 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 602/1207] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:15 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:16.235997 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6461c54e-3065-490a-a92e-c1a8eb09967b tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:16.236630 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6461c54e-3065-490a-a92e-c1a8eb09967b tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:16.244066 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6461c54e-3065-490a-a92e-c1a8eb09967b tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:16.244554 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6461c54e-3065-490a-a92e-c1a8eb09967b tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:16.244991 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6461c54e-3065-490a-a92e-c1a8eb09967b tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:16.245713 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6461c54e-3065-490a-a92e-c1a8eb09967b tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:16.246171 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6461c54e-3065-490a-a92e-c1a8eb09967b tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:16.246715 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-6461c54e-3065-490a-a92e-c1a8eb09967b tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:16.408784 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6461c54e-3065-490a-a92e-c1a8eb09967b tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:16.422863 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6461c54e-3065-490a-a92e-c1a8eb09967b tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1315 microversion: 2.1 time: 0.191600 Aug 08 17:02:16.423933 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 606/1208] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:16 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:17.458213 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f2c8e440-a394-4ba8-9559-2082a039ebeb tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:17.458866 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f2c8e440-a394-4ba8-9559-2082a039ebeb tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:17.466612 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f2c8e440-a394-4ba8-9559-2082a039ebeb tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:17.467098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f2c8e440-a394-4ba8-9559-2082a039ebeb tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:17.467539 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f2c8e440-a394-4ba8-9559-2082a039ebeb tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:17.468367 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f2c8e440-a394-4ba8-9559-2082a039ebeb tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:17.469188 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f2c8e440-a394-4ba8-9559-2082a039ebeb tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:17.469614 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f2c8e440-a394-4ba8-9559-2082a039ebeb tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:17.649294 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f2c8e440-a394-4ba8-9559-2082a039ebeb tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:17.657756 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f2c8e440-a394-4ba8-9559-2082a039ebeb tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1465 microversion: 2.1 time: 0.204026 Aug 08 17:02:17.658538 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 603/1209] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:17 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1465 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:17.706854 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b658d11d-4544-4353-8ca4-c9d177198238 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:17.707397 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b658d11d-4544-4353-8ca4-c9d177198238 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:17.714210 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b658d11d-4544-4353-8ca4-c9d177198238 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:17.714788 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b658d11d-4544-4353-8ca4-c9d177198238 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:17.715239 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b658d11d-4544-4353-8ca4-c9d177198238 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:17.715954 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b658d11d-4544-4353-8ca4-c9d177198238 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:17.716413 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b658d11d-4544-4353-8ca4-c9d177198238 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:17.716841 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b658d11d-4544-4353-8ca4-c9d177198238 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:17.744357 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b658d11d-4544-4353-8ca4-c9d177198238 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:02:18.039571 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b658d11d-4544-4353-8ca4-c9d177198238 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 204 len: 0 microversion: 2.1 time: 0.336323 Aug 08 17:02:18.040574 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 607/1210] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:02:17 2022] DELETE /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:02:18.049059 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0234f55c-0c21-4e14-9b82-5542bca555c3 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:18.049682 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0234f55c-0c21-4e14-9b82-5542bca555c3 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:18.056472 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0234f55c-0c21-4e14-9b82-5542bca555c3 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:18.057047 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0234f55c-0c21-4e14-9b82-5542bca555c3 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:18.057521 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0234f55c-0c21-4e14-9b82-5542bca555c3 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:18.058258 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0234f55c-0c21-4e14-9b82-5542bca555c3 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:18.058766 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0234f55c-0c21-4e14-9b82-5542bca555c3 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:18.059180 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0234f55c-0c21-4e14-9b82-5542bca555c3 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:18.195017 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-0234f55c-0c21-4e14-9b82-5542bca555c3 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:18.204118 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0234f55c-0c21-4e14-9b82-5542bca555c3 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1471 microversion: 2.1 time: 0.159129 Aug 08 17:02:18.204796 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 604/1211] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:18 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:19.226024 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-52d90645-21ec-4881-90c0-415daae1b9c6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:19.226699 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-52d90645-21ec-4881-90c0-415daae1b9c6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:19.232682 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52d90645-21ec-4881-90c0-415daae1b9c6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:19.233168 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52d90645-21ec-4881-90c0-415daae1b9c6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:19.234297 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52d90645-21ec-4881-90c0-415daae1b9c6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:19.235149 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52d90645-21ec-4881-90c0-415daae1b9c6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:19.235597 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52d90645-21ec-4881-90c0-415daae1b9c6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:19.236019 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-52d90645-21ec-4881-90c0-415daae1b9c6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:19.370288 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-52d90645-21ec-4881-90c0-415daae1b9c6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:19.378591 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-52d90645-21ec-4881-90c0-415daae1b9c6 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1471 microversion: 2.1 time: 0.156987 Aug 08 17:02:19.379183 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 608/1212] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:19 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:20.135778 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-1b921461-bb14-4120-a67d-c19c3134a343 req-71cb1fcc-3fab-46e0-8f98-8f77c3cb9095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c9e039-3f1c-4c52-bd66-957b42657e7d", "name": "network-vif-deleted", "tag": "185e4b79-6619-43bb-bfcd-1cdaf7e901db"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:20.147593 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-1b921461-bb14-4120-a67d-c19c3134a343 req-71cb1fcc-3fab-46e0-8f98-8f77c3cb9095 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:20.149237 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-1b921461-bb14-4120-a67d-c19c3134a343 req-71cb1fcc-3fab-46e0-8f98-8f77c3cb9095 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:20.149237 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-1b921461-bb14-4120-a67d-c19c3134a343 req-71cb1fcc-3fab-46e0-8f98-8f77c3cb9095 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:20.161933 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-1b921461-bb14-4120-a67d-c19c3134a343 req-71cb1fcc-3fab-46e0-8f98-8f77c3cb9095 service nova] Creating event network-vif-deleted:185e4b79-6619-43bb-bfcd-1cdaf7e901db for instance f2c9e039-3f1c-4c52-bd66-957b42657e7d on hv-cinder-85220 Aug 08 17:02:20.169269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-1b921461-bb14-4120-a67d-c19c3134a343 req-71cb1fcc-3fab-46e0-8f98-8f77c3cb9095 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036511 Aug 08 17:02:20.169661 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 605/1213] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:02:20.403432 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:20.404070 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:20.410556 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:20.411220 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:20.411580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:20.412289 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:20.412723 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:20.413176 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:20.444727 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:20.445200 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:20.445631 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:20.446070 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.objects.instance [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lazy-loading 'fault' on Instance uuid f2c9e039-3f1c-4c52-bd66-957b42657e7d {{(pid=130236) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:02:20.489015 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda9c43329f54e19bead646695ba29d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb2e613a7774f0291ba9cccc18cfb31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:20.496438 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9a1e648a-b8c6-4ec2-8ee6-1f1ecc8dfcb0 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 200 len: 1305 microversion: 2.1 time: 0.096903 Aug 08 17:02:20.497006 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 609/1214] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:20 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:02:21.518803 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-41d10451-4ad7-43e7-937f-aec971f09ae9 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:21.519552 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-41d10451-4ad7-43e7-937f-aec971f09ae9 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] [instance: f2c9e039-3f1c-4c52-bd66-957b42657e7d] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:21.525872 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-41d10451-4ad7-43e7-937f-aec971f09ae9 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:21.526519 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-41d10451-4ad7-43e7-937f-aec971f09ae9 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:21.526884 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-41d10451-4ad7-43e7-937f-aec971f09ae9 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:21.527583 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-41d10451-4ad7-43e7-937f-aec971f09ae9 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:21.528035 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-41d10451-4ad7-43e7-937f-aec971f09ae9 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:21.528457 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-41d10451-4ad7-43e7-937f-aec971f09ae9 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:21.542884 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-41d10451-4ad7-43e7-937f-aec971f09ae9 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] HTTP exception thrown: Instance f2c9e039-3f1c-4c52-bd66-957b42657e7d could not be found. Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-41d10451-4ad7-43e7-937f-aec971f09ae9 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Request method failure captured: Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d HTTP/1.1 Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8UF-x3QKlCtCT1oRHb86P4YFydwlIavoF_G0UJaIO_pvXCUMZP2lAc8yeOPKbcRdxhB8YIxZ-wibfA0VD0BzKA5ZjqSKuzzzcSiexNRhbrc8W1h6p6QbtlBI-fUARtkGuUKwJk_iOW09juIouSuS-5t6eKzSl3iym1oO1RSTxFgomlA Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: 4fb2e613a7774f0291ba9cccc18cfb31 Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-VolumesNegativeTest-1649278905 Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:02:21.544819 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:02:21.546680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4fb2e613a7774f0291ba9cccc18cfb31", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4fb2e613a7774f0291ba9cccc18cfb31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4fb2e613a7774f0291ba9cccc18cfb31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4fb2e613a7774f0291ba9cccc18cfb31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:02:21.546680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-VolumesNegativeTest-1649278905 Aug 08 17:02:21.546680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: 4fb2e613a7774f0291ba9cccc18cfb31 Aug 08 17:02:21.546680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-VolumesNegativeTest-1649278905 Aug 08 17:02:21.546680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-VolumesNegativeTest-1649278905-project Aug 08 17:02:21.546680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:02:21.546680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:02:21.546680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: eda9c43329f54e19bead646695ba29d2 Aug 08 17:02:21.546680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-VolumesNegativeTest-1649278905-project Aug 08 17:02:21.546680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:02:21.546680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance f2c9e039-3f1c-4c52-bd66-957b42657e7d could not be found. Aug 08 17:02:21.546680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'f2c9e039-3f1c-4c52-bd66-957b42657e7d'} Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c9e039-3f1c-4c52-bd66-957b42657e7d could not be found. Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:02:21.548214 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c9e039-3f1c-4c52-bd66-957b42657e7d could not be found. Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c9e039-3f1c-4c52-bd66-957b42657e7d could not be found. Aug 08 17:02:21.549594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:21.551019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-41d10451-4ad7-43e7-937f-aec971f09ae9 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] Returning 404 to user: Instance f2c9e039-3f1c-4c52-bd66-957b42657e7d could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:02:21.551019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-41d10451-4ad7-43e7-937f-aec971f09ae9 tempest-VolumesNegativeTest-1649278905 tempest-VolumesNegativeTest-1649278905-project] 10.222.0.13 "GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d" status: 404 len: 111 microversion: 2.1 time: 0.032614 Aug 08 17:02:21.551019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 606/1215] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:02:21 2022] GET /compute/v2.1/servers/f2c9e039-3f1c-4c52-bd66-957b42657e7d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:02:27.918479 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-76caaaa5-31d2-48f7-a17b-6cfc6c808dda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:27.920520 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-76caaaa5-31d2-48f7-a17b-6cfc6c808dda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:27.923522 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:27.929163 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76caaaa5-31d2-48f7-a17b-6cfc6c808dda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:27.929660 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76caaaa5-31d2-48f7-a17b-6cfc6c808dda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:27.930101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76caaaa5-31d2-48f7-a17b-6cfc6c808dda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:27.931255 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76caaaa5-31d2-48f7-a17b-6cfc6c808dda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:27.931716 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76caaaa5-31d2-48f7-a17b-6cfc6c808dda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:27.932167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-76caaaa5-31d2-48f7-a17b-6cfc6c808dda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:27.966364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-76caaaa5-31d2-48f7-a17b-6cfc6c808dda tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051970 Aug 08 17:02:27.967262 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 610/1216] 10.222.0.13 () {60 vars in 1343 bytes} [Mon Aug 8 17:02:27 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:02:28.037126 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-0e603bd0-c9d8-45e5-90bb-7e38b6f3f424 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:28.037756 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0e603bd0-c9d8-45e5-90bb-7e38b6f3f424 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:28.044941 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e603bd0-c9d8-45e5-90bb-7e38b6f3f424 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:28.045443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e603bd0-c9d8-45e5-90bb-7e38b6f3f424 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:28.045891 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e603bd0-c9d8-45e5-90bb-7e38b6f3f424 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:28.046662 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e603bd0-c9d8-45e5-90bb-7e38b6f3f424 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:28.047120 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e603bd0-c9d8-45e5-90bb-7e38b6f3f424 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:28.047551 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-0e603bd0-c9d8-45e5-90bb-7e38b6f3f424 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:28.075530 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-0e603bd0-c9d8-45e5-90bb-7e38b6f3f424 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Going to try to terminate instance {{(pid=130235) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:02:28.104936 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=100 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:02:28.515947 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-0e603bd0-c9d8-45e5-90bb-7e38b6f3f424 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 204 len: 0 microversion: 2.20 time: 0.483457 Aug 08 17:02:28.516546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 607/1217] 10.222.0.13 () {60 vars in 1280 bytes} [Mon Aug 8 17:02:28 2022] DELETE /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 17:02:28.527322 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fd5350b3-cec9-4ab3-89a3-2bea8994c193 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:28.527950 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fd5350b3-cec9-4ab3-89a3-2bea8994c193 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:28.534354 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd5350b3-cec9-4ab3-89a3-2bea8994c193 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:28.534871 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd5350b3-cec9-4ab3-89a3-2bea8994c193 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:28.535302 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd5350b3-cec9-4ab3-89a3-2bea8994c193 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:28.536006 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd5350b3-cec9-4ab3-89a3-2bea8994c193 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:28.536449 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd5350b3-cec9-4ab3-89a3-2bea8994c193 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:28.536869 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd5350b3-cec9-4ab3-89a3-2bea8994c193 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:28.683799 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fd5350b3-cec9-4ab3-89a3-2bea8994c193 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:28.693547 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fd5350b3-cec9-4ab3-89a3-2bea8994c193 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:28.695104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fd5350b3-cec9-4ab3-89a3-2bea8994c193 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:28.696307 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fd5350b3-cec9-4ab3-89a3-2bea8994c193 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.174417 Aug 08 17:02:28.696883 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 611/1218] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:28 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:29.721148 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-dc66ce8e-8a20-4f6c-a41a-d4926d79cfa2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:29.721846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-dc66ce8e-8a20-4f6c-a41a-d4926d79cfa2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:29.728317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dc66ce8e-8a20-4f6c-a41a-d4926d79cfa2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:29.728798 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dc66ce8e-8a20-4f6c-a41a-d4926d79cfa2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:29.729236 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dc66ce8e-8a20-4f6c-a41a-d4926d79cfa2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:29.729936 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dc66ce8e-8a20-4f6c-a41a-d4926d79cfa2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:29.730388 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dc66ce8e-8a20-4f6c-a41a-d4926d79cfa2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:29.730852 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-dc66ce8e-8a20-4f6c-a41a-d4926d79cfa2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:29.871255 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-dc66ce8e-8a20-4f6c-a41a-d4926d79cfa2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:29.880978 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-dc66ce8e-8a20-4f6c-a41a-d4926d79cfa2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:29.882476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-dc66ce8e-8a20-4f6c-a41a-d4926d79cfa2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:29.883692 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-dc66ce8e-8a20-4f6c-a41a-d4926d79cfa2 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1722 microversion: 2.20 time: 0.166931 Aug 08 17:02:29.884745 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 608/1219] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:29 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 17:02:30.907757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-de9f87a4-070f-41a6-952a-103275ab7956 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:30.908384 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-de9f87a4-070f-41a6-952a-103275ab7956 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:30.915212 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-de9f87a4-070f-41a6-952a-103275ab7956 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:30.915700 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-de9f87a4-070f-41a6-952a-103275ab7956 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:30.916134 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-de9f87a4-070f-41a6-952a-103275ab7956 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:30.916826 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-de9f87a4-070f-41a6-952a-103275ab7956 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:30.917278 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-de9f87a4-070f-41a6-952a-103275ab7956 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:30.917698 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-de9f87a4-070f-41a6-952a-103275ab7956 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:31.003004 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-de9f87a4-070f-41a6-952a-103275ab7956 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:31.003202 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-ea91604f-3163-41c8-be32-d4d6b8890247 req-8e5ccf72-a3e3-43fa-9a6c-6529dd4143c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37eeb765-0b75-4da4-be22-9fc72927ff6a", "name": "network-vif-deleted", "tag": "25f9ae20-5161-4130-bc9b-d7c23e20ddc0"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:02:31.009746 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-de9f87a4-070f-41a6-952a-103275ab7956 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:31.011277 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-de9f87a4-070f-41a6-952a-103275ab7956 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6d78cbc233a498db3a9268a4b93d737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4be8df3fe34d71a3c3d91995c1edae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:02:31.013309 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-de9f87a4-070f-41a6-952a-103275ab7956 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 200 len: 1654 microversion: 2.20 time: 0.109385 Aug 08 17:02:31.013880 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 612/1220] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:30 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 1654 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 17:02:31.014253 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-ea91604f-3163-41c8-be32-d4d6b8890247 req-8e5ccf72-a3e3-43fa-9a6c-6529dd4143c1 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:31.014839 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-ea91604f-3163-41c8-be32-d4d6b8890247 req-8e5ccf72-a3e3-43fa-9a6c-6529dd4143c1 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:31.015286 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-ea91604f-3163-41c8-be32-d4d6b8890247 req-8e5ccf72-a3e3-43fa-9a6c-6529dd4143c1 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:31.027375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-ea91604f-3163-41c8-be32-d4d6b8890247 req-8e5ccf72-a3e3-43fa-9a6c-6529dd4143c1 service nova] Creating event network-vif-deleted:25f9ae20-5161-4130-bc9b-d7c23e20ddc0 for instance 37eeb765-0b75-4da4-be22-9fc72927ff6a on hv-cinder-85220 Aug 08 17:02:31.033013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-ea91604f-3163-41c8-be32-d4d6b8890247 req-8e5ccf72-a3e3-43fa-9a6c-6529dd4143c1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033063 Aug 08 17:02:31.034728 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 609/1221] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:02:32.037113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b3565eb8-09e9-428d-a4b1-020ad8627ac4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:32.037863 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b3565eb8-09e9-428d-a4b1-020ad8627ac4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:32.044272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b3565eb8-09e9-428d-a4b1-020ad8627ac4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:32.044747 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b3565eb8-09e9-428d-a4b1-020ad8627ac4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:32.045210 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b3565eb8-09e9-428d-a4b1-020ad8627ac4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:32.045894 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b3565eb8-09e9-428d-a4b1-020ad8627ac4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:32.046343 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b3565eb8-09e9-428d-a4b1-020ad8627ac4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:32.046795 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b3565eb8-09e9-428d-a4b1-020ad8627ac4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:32.061694 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-b3565eb8-09e9-428d-a4b1-020ad8627ac4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] HTTP exception thrown: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b3565eb8-09e9-428d-a4b1-020ad8627ac4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Request method failure captured: Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a HTTP/1.1 Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T-qHEW5gtF_z_blI6_jMAax_vRxliY0Q56FiNYDN4NkCuuFAcrjnwor1xY-vGTtkLZjvhqgku68WoX2LWEduc4W_d1eP6aO9T4VR-FAaFFQpnUWBB74m2aCR0DHY2Mp7064IcLbG1BFQ9KDn8-_t4c7DvNUSsmyiL6QIDJUvs68iBg Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: fa4be8df3fe34d71a3c3d91995c1edae Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 17:02:32.064104 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 17:02:32.065655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4be8df3fe34d71a3c3d91995c1edae", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:02:32.065655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:32.065655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: fa4be8df3fe34d71a3c3d91995c1edae Aug 08 17:02:32.065655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:32.065655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-AttachVolumeShelveTestJSON-30285975-project Aug 08 17:02:32.065655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 17:02:32.065655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 17:02:32.065655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: d6d78cbc233a498db3a9268a4b93d737 Aug 08 17:02:32.065655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-AttachVolumeShelveTestJSON-30285975-project Aug 08 17:02:32.065655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 17:02:32.065655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:32.065655 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': '37eeb765-0b75-4da4-be22-9fc72927ff6a'} Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:02:32.066503 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:32.068059 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:32.069715 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b3565eb8-09e9-428d-a4b1-020ad8627ac4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Returning 404 to user: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:02:32.069715 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b3565eb8-09e9-428d-a4b1-020ad8627ac4 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 404 len: 111 microversion: 2.20 time: 0.033350 Aug 08 17:02:32.069715 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 613/1222] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:32 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:02:32.075501 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b1c5a1ed-ed73-418c-a82c-93059f7b9adc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '.version_select at 0x7f5016544700>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:32.164555 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b1c5a1ed-ed73-418c-a82c-93059f7b9adc tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-976051337" status: 204 len: 0 microversion: 2.20 time: 0.093738 Aug 08 17:02:32.165141 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 610/1223] 10.222.0.13 () {60 vars in 1259 bytes} [Mon Aug 8 17:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-976051337 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 17:02:34.273268 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e4421140-4bf3-499e-99cb-52d38f48f1e1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:34.273826 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e4421140-4bf3-499e-99cb-52d38f48f1e1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:34.280333 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4421140-4bf3-499e-99cb-52d38f48f1e1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:34.280813 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4421140-4bf3-499e-99cb-52d38f48f1e1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:34.281249 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4421140-4bf3-499e-99cb-52d38f48f1e1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:34.281944 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4421140-4bf3-499e-99cb-52d38f48f1e1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:34.282397 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4421140-4bf3-499e-99cb-52d38f48f1e1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:34.282850 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e4421140-4bf3-499e-99cb-52d38f48f1e1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:34.296920 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-e4421140-4bf3-499e-99cb-52d38f48f1e1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] HTTP exception thrown: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e4421140-4bf3-499e-99cb-52d38f48f1e1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Request method failure captured: Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: DELETE /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a HTTP/1.1 Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T-qHEW5gtF_z_blI6_jMAax_vRxliY0Q56FiNYDN4NkCuuFAcrjnwor1xY-vGTtkLZjvhqgku68WoX2LWEduc4W_d1eP6aO9T4VR-FAaFFQpnUWBB74m2aCR0DHY2Mp7064IcLbG1BFQ9KDn8-_t4c7DvNUSsmyiL6QIDJUvs68iBg Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: fa4be8df3fe34d71a3c3d91995c1edae Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 17:02:34.298615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 17:02:34.300578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4be8df3fe34d71a3c3d91995c1edae", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:02:34.300578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:34.300578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: fa4be8df3fe34d71a3c3d91995c1edae Aug 08 17:02:34.300578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:34.300578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-AttachVolumeShelveTestJSON-30285975-project Aug 08 17:02:34.300578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 17:02:34.300578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 17:02:34.300578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: d6d78cbc233a498db3a9268a4b93d737 Aug 08 17:02:34.300578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-AttachVolumeShelveTestJSON-30285975-project Aug 08 17:02:34.300578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 17:02:34.300578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:34.300578 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': '37eeb765-0b75-4da4-be22-9fc72927ff6a'} Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:02:34.301722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:34.303271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:34.304809 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e4421140-4bf3-499e-99cb-52d38f48f1e1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Returning 404 to user: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:02:34.304809 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e4421140-4bf3-499e-99cb-52d38f48f1e1 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 404 len: 111 microversion: 2.20 time: 0.031038 Aug 08 17:02:34.304809 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 614/1224] 10.222.0.13 () {60 vars in 1280 bytes} [Mon Aug 8 17:02:34 2022] DELETE /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:02:34.309225 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a7507f55-c255-48c4-8cb7-c5478b34e621 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:34.310236 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a7507f55-c255-48c4-8cb7-c5478b34e621 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: 37eeb765-0b75-4da4-be22-9fc72927ff6a] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:34.318043 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7507f55-c255-48c4-8cb7-c5478b34e621 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:34.318600 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7507f55-c255-48c4-8cb7-c5478b34e621 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:34.319044 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7507f55-c255-48c4-8cb7-c5478b34e621 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:34.319810 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7507f55-c255-48c4-8cb7-c5478b34e621 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:34.320264 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7507f55-c255-48c4-8cb7-c5478b34e621 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:34.320725 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a7507f55-c255-48c4-8cb7-c5478b34e621 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:34.334750 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-a7507f55-c255-48c4-8cb7-c5478b34e621 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] HTTP exception thrown: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a7507f55-c255-48c4-8cb7-c5478b34e621 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Request method failure captured: Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a HTTP/1.1 Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T-qHEW5gtF_z_blI6_jMAax_vRxliY0Q56FiNYDN4NkCuuFAcrjnwor1xY-vGTtkLZjvhqgku68WoX2LWEduc4W_d1eP6aO9T4VR-FAaFFQpnUWBB74m2aCR0DHY2Mp7064IcLbG1BFQ9KDn8-_t4c7DvNUSsmyiL6QIDJUvs68iBg Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: fa4be8df3fe34d71a3c3d91995c1edae Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:02:34.336569 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:02:34.338375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4be8df3fe34d71a3c3d91995c1edae", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:02:34.338375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:34.338375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: fa4be8df3fe34d71a3c3d91995c1edae Aug 08 17:02:34.338375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:34.338375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeShelveTestJSON-30285975-project Aug 08 17:02:34.338375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:02:34.338375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:02:34.338375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: d6d78cbc233a498db3a9268a4b93d737 Aug 08 17:02:34.338375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeShelveTestJSON-30285975-project Aug 08 17:02:34.338375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:02:34.338375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:34.338375 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '37eeb765-0b75-4da4-be22-9fc72927ff6a'} Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:02:34.339446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. Aug 08 17:02:34.340955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:34.342446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a7507f55-c255-48c4-8cb7-c5478b34e621 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Returning 404 to user: Instance 37eeb765-0b75-4da4-be22-9fc72927ff6a could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:02:34.342446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a7507f55-c255-48c4-8cb7-c5478b34e621 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a" status: 404 len: 111 microversion: 2.20 time: 0.033168 Aug 08 17:02:34.342446 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 611/1225] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:34 2022] GET /compute/v2.1/servers/37eeb765-0b75-4da4-be22-9fc72927ff6a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:02:35.685544 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-dc98980b-ddbe-4110-bd36-c28c02bb31dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:35.686043 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-dc98980b-ddbe-4110-bd36-c28c02bb31dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:35.693552 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc98980b-ddbe-4110-bd36-c28c02bb31dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:35.694009 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc98980b-ddbe-4110-bd36-c28c02bb31dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:35.694440 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc98980b-ddbe-4110-bd36-c28c02bb31dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:35.695176 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc98980b-ddbe-4110-bd36-c28c02bb31dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:35.695615 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc98980b-ddbe-4110-bd36-c28c02bb31dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:35.696031 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-dc98980b-ddbe-4110-bd36-c28c02bb31dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:35.709841 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-dc98980b-ddbe-4110-bd36-c28c02bb31dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] HTTP exception thrown: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-dc98980b-ddbe-4110-bd36-c28c02bb31dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Request method failure captured: Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: DELETE /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 HTTP/1.1 Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8T-qHEW5gtF_z_blI6_jMAax_vRxliY0Q56FiNYDN4NkCuuFAcrjnwor1xY-vGTtkLZjvhqgku68WoX2LWEduc4W_d1eP6aO9T4VR-FAaFFQpnUWBB74m2aCR0DHY2Mp7064IcLbG1BFQ9KDn8-_t4c7DvNUSsmyiL6QIDJUvs68iBg Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: fa4be8df3fe34d71a3c3d91995c1edae Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 17:02:35.711436 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 17:02:35.713135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4be8df3fe34d71a3c3d91995c1edae", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:02:35.713135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:35.713135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: fa4be8df3fe34d71a3c3d91995c1edae Aug 08 17:02:35.713135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:35.713135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-AttachVolumeShelveTestJSON-30285975-project Aug 08 17:02:35.713135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 17:02:35.713135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 17:02:35.713135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: d6d78cbc233a498db3a9268a4b93d737 Aug 08 17:02:35.713135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-AttachVolumeShelveTestJSON-30285975-project Aug 08 17:02:35.713135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 17:02:35.713135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 17:02:35.713135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': 'f70c7402-29f3-48b0-b5fc-dd586f6e4266'} Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:02:35.714082 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 17:02:35.715637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:02:35.717119 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-dc98980b-ddbe-4110-bd36-c28c02bb31dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Returning 404 to user: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:02:35.717119 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-dc98980b-ddbe-4110-bd36-c28c02bb31dd tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 404 len: 111 microversion: 2.20 time: 0.031530 Aug 08 17:02:35.717119 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 615/1226] 10.222.0.13 () {60 vars in 1280 bytes} [Mon Aug 8 17:02:35 2022] DELETE /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 17:02:35.721443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-47e2f472-86c1-461f-8f78-2c6731573ec7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:02:35.722098 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-47e2f472-86c1-461f-8f78-2c6731573ec7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] [instance: f70c7402-29f3-48b0-b5fc-dd586f6e4266] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:02:35.728786 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-47e2f472-86c1-461f-8f78-2c6731573ec7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:35.729202 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-47e2f472-86c1-461f-8f78-2c6731573ec7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:35.729639 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-47e2f472-86c1-461f-8f78-2c6731573ec7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:35.730336 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-47e2f472-86c1-461f-8f78-2c6731573ec7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:02:35.730825 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-47e2f472-86c1-461f-8f78-2c6731573ec7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:02:35.731251 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-47e2f472-86c1-461f-8f78-2c6731573ec7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:02:35.745323 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-47e2f472-86c1-461f-8f78-2c6731573ec7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] HTTP exception thrown: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-47e2f472-86c1-461f-8f78-2c6731573ec7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Request method failure captured: Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 HTTP/1.1 Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8T-qHEW5gtF_z_blI6_jMAax_vRxliY0Q56FiNYDN4NkCuuFAcrjnwor1xY-vGTtkLZjvhqgku68WoX2LWEduc4W_d1eP6aO9T4VR-FAaFFQpnUWBB74m2aCR0DHY2Mp7064IcLbG1BFQ9KDn8-_t4c7DvNUSsmyiL6QIDJUvs68iBg Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: fa4be8df3fe34d71a3c3d91995c1edae Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:02:35.746911 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:02:35.748562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4be8df3fe34d71a3c3d91995c1edae", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4be8df3fe34d71a3c3d91995c1edae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:02:35.748562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:35.748562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: fa4be8df3fe34d71a3c3d91995c1edae Aug 08 17:02:35.748562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-30285975 Aug 08 17:02:35.748562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-AttachVolumeShelveTestJSON-30285975-project Aug 08 17:02:35.748562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:02:35.748562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:02:35.748562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: d6d78cbc233a498db3a9268a4b93d737 Aug 08 17:02:35.748562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-AttachVolumeShelveTestJSON-30285975-project Aug 08 17:02:35.748562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:02:35.748562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 17:02:35.748562 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'f70c7402-29f3-48b0-b5fc-dd586f6e4266'} Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:02:35.750269 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. Aug 08 17:02:35.751841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:02:35.753809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-47e2f472-86c1-461f-8f78-2c6731573ec7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] Returning 404 to user: Instance f70c7402-29f3-48b0-b5fc-dd586f6e4266 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:02:35.753809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-47e2f472-86c1-461f-8f78-2c6731573ec7 tempest-AttachVolumeShelveTestJSON-30285975 tempest-AttachVolumeShelveTestJSON-30285975-project] 10.222.0.13 "GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266" status: 404 len: 111 microversion: 2.20 time: 0.030798 Aug 08 17:02:35.753809 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 612/1227] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Aug 8 17:02:35 2022] GET /compute/v2.1/servers/f70c7402-29f3-48b0-b5fc-dd586f6e4266 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 08 17:03:26.857065 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-41a28537-3b6c-4680-87d2-3cb0d76a1520 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:26.858019 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-41a28537-3b6c-4680-87d2-3cb0d76a1520 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:26.860170 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=11 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:26.860995 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:26.861166 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:26.861887 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:26.870497 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-41a28537-3b6c-4680-87d2-3cb0d76a1520 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:26.871306 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-41a28537-3b6c-4680-87d2-3cb0d76a1520 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:26.872652 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-41a28537-3b6c-4680-87d2-3cb0d76a1520 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:26.873632 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-41a28537-3b6c-4680-87d2-3cb0d76a1520 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:26.874493 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-41a28537-3b6c-4680-87d2-3cb0d76a1520 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:26.875413 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-41a28537-3b6c-4680-87d2-3cb0d76a1520 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:26.942745 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-41a28537-3b6c-4680-87d2-3cb0d76a1520 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:03:27.054814 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-ec47a00b-0431-41b7-a887-202f3968d724 req-929284db-4421-4d13-bb02-51879e71765c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff2191f-71f9-44b6-ae73-7e7385c80748", "tag": "c2eba598-5d72-4cf8-b348-8af93d348bb8"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:27.064107 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-ec47a00b-0431-41b7-a887-202f3968d724 req-929284db-4421-4d13-bb02-51879e71765c service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:27.065032 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-ec47a00b-0431-41b7-a887-202f3968d724 req-929284db-4421-4d13-bb02-51879e71765c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:27.065802 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-ec47a00b-0431-41b7-a887-202f3968d724 req-929284db-4421-4d13-bb02-51879e71765c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:27.078406 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-ec47a00b-0431-41b7-a887-202f3968d724 req-929284db-4421-4d13-bb02-51879e71765c service nova] Creating event network-changed:c2eba598-5d72-4cf8-b348-8af93d348bb8 for instance eff2191f-71f9-44b6-ae73-7e7385c80748 on hv-cinder-85220 Aug 08 17:03:27.085025 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-ec47a00b-0431-41b7-a887-202f3968d724 req-929284db-4421-4d13-bb02-51879e71765c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228543 Aug 08 17:03:27.085624 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 613/1228] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:03:27.353562 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-41a28537-3b6c-4680-87d2-3cb0d76a1520 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 204 len: 0 microversion: 2.1 time: 0.499610 Aug 08 17:03:27.354515 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 616/1229] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:03:26 2022] DELETE /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 17:03:27.374958 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e646e6f1-cff6-4b88-9f93-ce3df16eef3a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:27.376660 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e646e6f1-cff6-4b88-9f93-ce3df16eef3a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:27.389267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e646e6f1-cff6-4b88-9f93-ce3df16eef3a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:27.390633 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e646e6f1-cff6-4b88-9f93-ce3df16eef3a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:27.391813 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e646e6f1-cff6-4b88-9f93-ce3df16eef3a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:27.393618 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e646e6f1-cff6-4b88-9f93-ce3df16eef3a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:27.395052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e646e6f1-cff6-4b88-9f93-ce3df16eef3a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:27.396084 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e646e6f1-cff6-4b88-9f93-ce3df16eef3a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:27.574405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e646e6f1-cff6-4b88-9f93-ce3df16eef3a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:27.586351 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e646e6f1-cff6-4b88-9f93-ce3df16eef3a tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.223634 Aug 08 17:03:27.588058 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 614/1230] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:27 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:28.725365 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c8d39de1-0b43-4a8f-9d31-42dfd7b5e8f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:28.726141 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c8d39de1-0b43-4a8f-9d31-42dfd7b5e8f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:28.732826 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8d39de1-0b43-4a8f-9d31-42dfd7b5e8f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:28.733425 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8d39de1-0b43-4a8f-9d31-42dfd7b5e8f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:28.733866 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8d39de1-0b43-4a8f-9d31-42dfd7b5e8f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:28.734739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8d39de1-0b43-4a8f-9d31-42dfd7b5e8f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:28.735176 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8d39de1-0b43-4a8f-9d31-42dfd7b5e8f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:28.735779 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c8d39de1-0b43-4a8f-9d31-42dfd7b5e8f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:28.874960 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c8d39de1-0b43-4a8f-9d31-42dfd7b5e8f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:28.882722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c8d39de1-0b43-4a8f-9d31-42dfd7b5e8f2 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1567 microversion: 2.1 time: 0.278194 Aug 08 17:03:28.883298 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 617/1231] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:28 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1567 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:29.693062 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-37208b4c-a353-412d-b8ea-b93f10dd6456 req-9fe4cf7f-ebdf-4663-864c-812424cf4b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff2191f-71f9-44b6-ae73-7e7385c80748", "name": "network-vif-deleted", "tag": "c2eba598-5d72-4cf8-b348-8af93d348bb8"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:29.703074 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-37208b4c-a353-412d-b8ea-b93f10dd6456 req-9fe4cf7f-ebdf-4663-864c-812424cf4b3a service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:29.704844 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-37208b4c-a353-412d-b8ea-b93f10dd6456 req-9fe4cf7f-ebdf-4663-864c-812424cf4b3a service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:29.704844 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-37208b4c-a353-412d-b8ea-b93f10dd6456 req-9fe4cf7f-ebdf-4663-864c-812424cf4b3a service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:29.715457 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-37208b4c-a353-412d-b8ea-b93f10dd6456 req-9fe4cf7f-ebdf-4663-864c-812424cf4b3a service nova] Creating event network-vif-deleted:c2eba598-5d72-4cf8-b348-8af93d348bb8 for instance eff2191f-71f9-44b6-ae73-7e7385c80748 on hv-cinder-85220 Aug 08 17:03:29.720629 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-37208b4c-a353-412d-b8ea-b93f10dd6456 req-9fe4cf7f-ebdf-4663-864c-812424cf4b3a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091291 Aug 08 17:03:29.721102 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 615/1232] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:03:29.905407 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ce420939-0544-47e3-a176-636cb85e4419 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:29.906057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ce420939-0544-47e3-a176-636cb85e4419 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:29.913171 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ce420939-0544-47e3-a176-636cb85e4419 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:29.913653 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ce420939-0544-47e3-a176-636cb85e4419 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:29.914083 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ce420939-0544-47e3-a176-636cb85e4419 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:29.914837 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ce420939-0544-47e3-a176-636cb85e4419 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:29.915284 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ce420939-0544-47e3-a176-636cb85e4419 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:29.915704 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ce420939-0544-47e3-a176-636cb85e4419 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:30.006271 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ce420939-0544-47e3-a176-636cb85e4419 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:30.014364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ce420939-0544-47e3-a176-636cb85e4419 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1220 microversion: 2.1 time: 0.112978 Aug 08 17:03:30.014951 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 618/1233] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:29 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1220 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:31.036248 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:31.037046 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:31.044242 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:31.044736 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:31.045838 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:31.046552 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:31.047042 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:31.047467 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:31.084378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:31.085268 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:31.085546 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:31.086863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lazy-loading 'fault' on Instance uuid eff2191f-71f9-44b6-ae73-7e7385c80748 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:03:31.149534 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b15aebfb044c3893831f84f1aa1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ca0765d1fb44cda1c4c2562a695ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:03:31.157852 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-565df2b9-6582-48f6-8832-22ee221dcc48 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 200 len: 1225 microversion: 2.1 time: 0.126274 Aug 08 17:03:31.158430 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 616/1234] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:31 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:03:32.178962 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-98964ef6-9fb7-45e6-b1a8-cee8cc5cbac4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:32.179572 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-98964ef6-9fb7-45e6-b1a8-cee8cc5cbac4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] [instance: eff2191f-71f9-44b6-ae73-7e7385c80748] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:03:32.186371 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-98964ef6-9fb7-45e6-b1a8-cee8cc5cbac4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:32.187648 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-98964ef6-9fb7-45e6-b1a8-cee8cc5cbac4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:32.188321 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-98964ef6-9fb7-45e6-b1a8-cee8cc5cbac4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:32.189015 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-98964ef6-9fb7-45e6-b1a8-cee8cc5cbac4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:03:32.189469 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-98964ef6-9fb7-45e6-b1a8-cee8cc5cbac4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:03:32.189890 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-98964ef6-9fb7-45e6-b1a8-cee8cc5cbac4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:03:32.205069 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-98964ef6-9fb7-45e6-b1a8-cee8cc5cbac4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] HTTP exception thrown: Instance eff2191f-71f9-44b6-ae73-7e7385c80748 could not be found. Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-98964ef6-9fb7-45e6-b1a8-cee8cc5cbac4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Request method failure captured: Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 HTTP/1.1 Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8UCtpUck6OnAS5xvWl9dGnIOBxOw7S3jjIZS0itlBJy3dpgiex5GmNshjJYLBArglekvmwEbv4p2RbxTP3YhZa-NnEx--H9Cag7sMSnxjTfRwpB4149lNiFfKT_Neb34vSZ9BsX67zLMHxlLWOLnXI2u8-E1IJdaQHP48J-zAJqVmgc Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: 73ca0765d1fb44cda1c4c2562a695ac6 Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-TestShelveInstance-697592726 Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 17:03:32.206770 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 17:03:32.208617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_73ca0765d1fb44cda1c4c2562a695ac6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/73ca0765d1fb44cda1c4c2562a695ac6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73ca0765d1fb44cda1c4c2562a695ac6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73ca0765d1fb44cda1c4c2562a695ac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:03:32.208617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-TestShelveInstance-697592726 Aug 08 17:03:32.208617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: 73ca0765d1fb44cda1c4c2562a695ac6 Aug 08 17:03:32.208617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-TestShelveInstance-697592726 Aug 08 17:03:32.208617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-TestShelveInstance-697592726-project Aug 08 17:03:32.208617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 17:03:32.208617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 17:03:32.208617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: 803b15aebfb044c3893831f84f1aa1d7 Aug 08 17:03:32.208617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-TestShelveInstance-697592726-project Aug 08 17:03:32.208617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 17:03:32.208617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance eff2191f-71f9-44b6-ae73-7e7385c80748 could not be found. Aug 08 17:03:32.208617 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': 'eff2191f-71f9-44b6-ae73-7e7385c80748'} Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eff2191f-71f9-44b6-ae73-7e7385c80748 could not be found. Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:03:32.209762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eff2191f-71f9-44b6-ae73-7e7385c80748 could not be found. Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eff2191f-71f9-44b6-ae73-7e7385c80748 could not be found. Aug 08 17:03:32.212827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:03:32.218364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-98964ef6-9fb7-45e6-b1a8-cee8cc5cbac4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Returning 404 to user: Instance eff2191f-71f9-44b6-ae73-7e7385c80748 could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:03:32.218364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-98964ef6-9fb7-45e6-b1a8-cee8cc5cbac4 tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748" status: 404 len: 111 microversion: 2.1 time: 0.033216 Aug 08 17:03:32.218364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 619/1235] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:03:32 2022] GET /compute/v2.1/servers/eff2191f-71f9-44b6-ae73-7e7385c80748 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:03:32.453559 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a20b3e43-93f5-4979-8810-06b636b5f1db tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] Calling method '.version_select at 0x7f501a9f7040>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:03:32.614679 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a20b3e43-93f5-4979-8810-06b636b5f1db tempest-TestShelveInstance-697592726 tempest-TestShelveInstance-697592726-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1165660734" status: 202 len: 0 microversion: 2.1 time: 0.165337 Aug 08 17:03:32.615262 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 617/1236] 10.222.0.13 () {58 vars in 1254 bytes} [Mon Aug 8 17:03:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1165660734 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:03:55.693164 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:55.693912 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:03:55.870695 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-041ccaaf-0833-4223-8819-2b0d76b40da6 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Action: 'create', calling method: .version_select at 0x7f501aa16280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1799878524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZQ5xMEm5gF2Rs+9njw+kcwAp88a/DLJNsBEYDUFoyD3ZFdffuNzasI9puvfAlnLHfMV0mkdorfWylbQyi3JDmmjQ8gjE96UzkBmE+RWsF0Xb57aMcX0S669yuvq12h+g=="}} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:03:55.886772 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-041ccaaf-0833-4223-8819-2b0d76b40da6 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Getting quotas for project f30f18b2d4fe4a9fa54fce853aa4c5cf. Resources: {'key_pairs'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:03:55.891396 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.quota [None req-041ccaaf-0833-4223-8819-2b0d76b40da6 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Getting quotas for user bd48464ff95749cd8b36b2fea90ddb31 and project f30f18b2d4fe4a9fa54fce853aa4c5cf. Resources: {'key_pairs'} {{(pid=130236) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:03:55.970461 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-041ccaaf-0833-4223-8819-2b0d76b40da6 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.281965 Aug 08 17:03:55.971107 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 620/1237] 10.222.0.13 () {60 vars in 1159 bytes} [Mon Aug 8 17:03:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:04:14.256073 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=18 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:14.256814 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:14.260794 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1400332142", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1799878524", "security_groups": [{"name": "tempest-secgroup-smoke-418551888"}], "block_device_mapping_v2": [{"uuid": "e0cf6664-a2c3-4283-b4fc-b44478b75d15", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0928dfca-2889-483b-a2d3-f6a5fb21fcb6"}]}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:14.380740 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.network.neutron [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] validate_networks() for [('0928dfca-2889-483b-a2d3-f6a5fb21fcb6', None, None, None, None, None)] {{(pid=130235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:04:14.911001 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Flavor limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:04:14.911417 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Image limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:04:14.911887 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Flavor pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:04:14.912288 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Image pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:04:14.912696 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:04:14.922867 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:14.923362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:14.923802 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:14.924541 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:14.925019 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:14.925443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:14.945362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Getting quotas for project f30f18b2d4fe4a9fa54fce853aa4c5cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:04:14.950039 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Getting quotas for user bd48464ff95749cd8b36b2fea90ddb31 and project f30f18b2d4fe4a9fa54fce853aa4c5cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:04:15.014643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Going to run 1 instances... {{(pid=130235) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:04:15.016811 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0cf6664-a2c3-4283-b4fc-b44478b75d15',volume_size=None,volume_type=None)] {{(pid=130235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:04:15.595748 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-6c633cab-60cb-44a1-bddd-464fc13b55b1 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.341089 Aug 08 17:04:15.596479 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 618/1238] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 17:04:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:04:15.604778 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=4 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:15.605978 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:15.610352 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9434ec41-d141-4cc3-8c14-7c4bbc4e7f90 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:15.611768 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-9434ec41-d141-4cc3-8c14-7c4bbc4e7f90 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:15.668994 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-9434ec41-d141-4cc3-8c14-7c4bbc4e7f90 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:15.676552 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9434ec41-d141-4cc3-8c14-7c4bbc4e7f90 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1095 microversion: 2.1 time: 0.072972 Aug 08 17:04:15.677128 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 621/1239] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:15 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:16.698640 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-c39cb08e-4454-4dd7-b818-2899b6dbd9a9 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:16.699368 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-c39cb08e-4454-4dd7-b818-2899b6dbd9a9 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:16.777878 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-c39cb08e-4454-4dd7-b818-2899b6dbd9a9 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:16.787506 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-c39cb08e-4454-4dd7-b818-2899b6dbd9a9 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1095 microversion: 2.1 time: 0.093274 Aug 08 17:04:16.788102 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 619/1240] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:16 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1095 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:17.813326 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-34ab5990-c05b-440f-8b80-65c1cedc69e5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:17.814024 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-34ab5990-c05b-440f-8b80-65c1cedc69e5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:17.821435 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-34ab5990-c05b-440f-8b80-65c1cedc69e5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:17.824018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-34ab5990-c05b-440f-8b80-65c1cedc69e5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:17.824018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-34ab5990-c05b-440f-8b80-65c1cedc69e5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:17.824018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-34ab5990-c05b-440f-8b80-65c1cedc69e5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:17.824018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-34ab5990-c05b-440f-8b80-65c1cedc69e5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:17.824441 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-34ab5990-c05b-440f-8b80-65c1cedc69e5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:17.897452 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-34ab5990-c05b-440f-8b80-65c1cedc69e5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:17.906490 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-34ab5990-c05b-440f-8b80-65c1cedc69e5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1193 microversion: 2.1 time: 0.097269 Aug 08 17:04:17.907112 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 622/1241] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:17 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:18.939683 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8cac09b5-3c7f-4020-a0cf-df41609e45ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:18.940575 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8cac09b5-3c7f-4020-a0cf-df41609e45ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:18.949350 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8cac09b5-3c7f-4020-a0cf-df41609e45ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:18.950199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8cac09b5-3c7f-4020-a0cf-df41609e45ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:18.951027 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8cac09b5-3c7f-4020-a0cf-df41609e45ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:18.951910 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8cac09b5-3c7f-4020-a0cf-df41609e45ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:18.952440 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8cac09b5-3c7f-4020-a0cf-df41609e45ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:18.952932 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8cac09b5-3c7f-4020-a0cf-df41609e45ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:19.064421 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8cac09b5-3c7f-4020-a0cf-df41609e45ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:19.077347 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8cac09b5-3c7f-4020-a0cf-df41609e45ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1211 microversion: 2.1 time: 0.142258 Aug 08 17:04:19.078355 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 620/1242] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:18 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1211 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:20.099733 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-772cc301-9509-44d4-8385-1ca8879ab3b4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:20.100919 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-772cc301-9509-44d4-8385-1ca8879ab3b4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:20.109111 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-772cc301-9509-44d4-8385-1ca8879ab3b4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:20.109728 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-772cc301-9509-44d4-8385-1ca8879ab3b4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:20.110206 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-772cc301-9509-44d4-8385-1ca8879ab3b4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:20.111230 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-772cc301-9509-44d4-8385-1ca8879ab3b4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:20.111760 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-772cc301-9509-44d4-8385-1ca8879ab3b4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:20.112315 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-772cc301-9509-44d4-8385-1ca8879ab3b4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:20.265534 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-772cc301-9509-44d4-8385-1ca8879ab3b4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:20.273755 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-772cc301-9509-44d4-8385-1ca8879ab3b4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1266 microversion: 2.1 time: 0.178676 Aug 08 17:04:20.275018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 623/1243] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:20 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:20.616676 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-b095d482-3447-4943-8729-45ea99d05e58 req-335dc7ae-1e82-4ca5-97ae-106b49add5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "622725fc-56b2-4713-b7ff-8f52c495c402", "tag": "0fc25895-0d3b-46b3-b004-b2fd801884d4"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:20.627865 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b095d482-3447-4943-8729-45ea99d05e58 req-335dc7ae-1e82-4ca5-97ae-106b49add5f8 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:20.628453 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b095d482-3447-4943-8729-45ea99d05e58 req-335dc7ae-1e82-4ca5-97ae-106b49add5f8 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:20.628899 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-b095d482-3447-4943-8729-45ea99d05e58 req-335dc7ae-1e82-4ca5-97ae-106b49add5f8 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:20.642008 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-b095d482-3447-4943-8729-45ea99d05e58 req-335dc7ae-1e82-4ca5-97ae-106b49add5f8 service nova] Creating event network-changed:0fc25895-0d3b-46b3-b004-b2fd801884d4 for instance 622725fc-56b2-4713-b7ff-8f52c495c402 on hv-cinder-85220 Aug 08 17:04:20.647872 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-b095d482-3447-4943-8729-45ea99d05e58 req-335dc7ae-1e82-4ca5-97ae-106b49add5f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035030 Aug 08 17:04:20.648907 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 621/1244] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:04:21.302365 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5384d50e-5132-4086-bc46-cbec8b8d9e76 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:21.303136 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5384d50e-5132-4086-bc46-cbec8b8d9e76 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:21.311414 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5384d50e-5132-4086-bc46-cbec8b8d9e76 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:21.311683 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5384d50e-5132-4086-bc46-cbec8b8d9e76 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:21.312120 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5384d50e-5132-4086-bc46-cbec8b8d9e76 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:21.312876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5384d50e-5132-4086-bc46-cbec8b8d9e76 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:21.313351 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5384d50e-5132-4086-bc46-cbec8b8d9e76 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:21.313772 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5384d50e-5132-4086-bc46-cbec8b8d9e76 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:21.456535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-5384d50e-5132-4086-bc46-cbec8b8d9e76 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:21.464375 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5384d50e-5132-4086-bc46-cbec8b8d9e76 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1266 microversion: 2.1 time: 0.166127 Aug 08 17:04:21.464946 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 624/1245] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:21 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:22.486092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-81a7cc2c-1200-4050-ae65-3cdcd92a4f34 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:22.486850 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-81a7cc2c-1200-4050-ae65-3cdcd92a4f34 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:22.493313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81a7cc2c-1200-4050-ae65-3cdcd92a4f34 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:22.493808 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81a7cc2c-1200-4050-ae65-3cdcd92a4f34 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:22.494244 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81a7cc2c-1200-4050-ae65-3cdcd92a4f34 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:22.494974 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81a7cc2c-1200-4050-ae65-3cdcd92a4f34 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:22.495421 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81a7cc2c-1200-4050-ae65-3cdcd92a4f34 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:22.495839 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-81a7cc2c-1200-4050-ae65-3cdcd92a4f34 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:22.630696 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-81a7cc2c-1200-4050-ae65-3cdcd92a4f34 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:22.639772 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-81a7cc2c-1200-4050-ae65-3cdcd92a4f34 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1266 microversion: 2.1 time: 0.158578 Aug 08 17:04:22.640353 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 622/1246] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:22 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:23.660405 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-129d521f-51ee-4fda-8373-da795a93de38 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:23.661048 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-129d521f-51ee-4fda-8373-da795a93de38 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:23.667774 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-129d521f-51ee-4fda-8373-da795a93de38 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:23.668261 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-129d521f-51ee-4fda-8373-da795a93de38 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:23.668708 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-129d521f-51ee-4fda-8373-da795a93de38 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:23.669425 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-129d521f-51ee-4fda-8373-da795a93de38 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:23.669889 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-129d521f-51ee-4fda-8373-da795a93de38 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:23.670344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-129d521f-51ee-4fda-8373-da795a93de38 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:23.809484 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-129d521f-51ee-4fda-8373-da795a93de38 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:23.817350 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-129d521f-51ee-4fda-8373-da795a93de38 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1266 microversion: 2.1 time: 0.160815 Aug 08 17:04:23.817951 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 625/1247] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:23 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:24.840037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-730d9eb6-c3a7-4c2d-823d-858ee8309b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:24.840672 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-730d9eb6-c3a7-4c2d-823d-858ee8309b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:24.848256 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-730d9eb6-c3a7-4c2d-823d-858ee8309b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:24.848739 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-730d9eb6-c3a7-4c2d-823d-858ee8309b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:24.849173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-730d9eb6-c3a7-4c2d-823d-858ee8309b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:24.849869 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-730d9eb6-c3a7-4c2d-823d-858ee8309b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:24.850315 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-730d9eb6-c3a7-4c2d-823d-858ee8309b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:24.850772 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-730d9eb6-c3a7-4c2d-823d-858ee8309b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:24.933839 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:24.993454 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-730d9eb6-c3a7-4c2d-823d-858ee8309b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:25.001436 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-730d9eb6-c3a7-4c2d-823d-858ee8309b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1266 microversion: 2.1 time: 0.165545 Aug 08 17:04:25.002010 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 623/1248] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:24 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:26.019687 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:26.023581 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-81f2c671-e864-48d2-a03e-b22610168a1f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:26.024195 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-81f2c671-e864-48d2-a03e-b22610168a1f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:26.030783 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-81f2c671-e864-48d2-a03e-b22610168a1f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:26.035641 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-81f2c671-e864-48d2-a03e-b22610168a1f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:26.035641 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-81f2c671-e864-48d2-a03e-b22610168a1f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:26.035641 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-81f2c671-e864-48d2-a03e-b22610168a1f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:26.035641 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-81f2c671-e864-48d2-a03e-b22610168a1f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:26.036056 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-81f2c671-e864-48d2-a03e-b22610168a1f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:26.173607 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-81f2c671-e864-48d2-a03e-b22610168a1f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:26.181290 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-81f2c671-e864-48d2-a03e-b22610168a1f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1266 microversion: 2.1 time: 0.162979 Aug 08 17:04:26.181869 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 626/1249] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:26 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:27.203529 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-4c77d14d-5629-472d-a390-67222b837a1b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:27.204104 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-4c77d14d-5629-472d-a390-67222b837a1b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:27.205966 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=8 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:04:27.210851 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4c77d14d-5629-472d-a390-67222b837a1b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:27.211345 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4c77d14d-5629-472d-a390-67222b837a1b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:27.211786 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4c77d14d-5629-472d-a390-67222b837a1b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:27.212565 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4c77d14d-5629-472d-a390-67222b837a1b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:27.213017 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4c77d14d-5629-472d-a390-67222b837a1b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:27.213445 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-4c77d14d-5629-472d-a390-67222b837a1b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:27.355491 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-4c77d14d-5629-472d-a390-67222b837a1b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:27.362091 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-4c77d14d-5629-472d-a390-67222b837a1b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1266 microversion: 2.1 time: 0.163309 Aug 08 17:04:27.362799 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 624/1250] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:27 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:28.383772 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-1183cc2d-d707-49ea-96ef-2fa4d1828ac8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:28.384364 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-1183cc2d-d707-49ea-96ef-2fa4d1828ac8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:28.391700 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1183cc2d-d707-49ea-96ef-2fa4d1828ac8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:28.392179 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1183cc2d-d707-49ea-96ef-2fa4d1828ac8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:28.392613 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1183cc2d-d707-49ea-96ef-2fa4d1828ac8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:28.393363 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1183cc2d-d707-49ea-96ef-2fa4d1828ac8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:28.393812 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1183cc2d-d707-49ea-96ef-2fa4d1828ac8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:28.394234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-1183cc2d-d707-49ea-96ef-2fa4d1828ac8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:28.530557 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-1183cc2d-d707-49ea-96ef-2fa4d1828ac8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:28.538093 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-1183cc2d-d707-49ea-96ef-2fa4d1828ac8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1266 microversion: 2.1 time: 0.158391 Aug 08 17:04:28.538673 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 627/1251] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:28 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:29.560393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-85d1ac5e-530a-4cb6-b0e2-e947440a9b56 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:29.561041 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-85d1ac5e-530a-4cb6-b0e2-e947440a9b56 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:29.567404 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-85d1ac5e-530a-4cb6-b0e2-e947440a9b56 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:29.567878 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-85d1ac5e-530a-4cb6-b0e2-e947440a9b56 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:29.568307 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-85d1ac5e-530a-4cb6-b0e2-e947440a9b56 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:29.568985 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-85d1ac5e-530a-4cb6-b0e2-e947440a9b56 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:29.569430 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-85d1ac5e-530a-4cb6-b0e2-e947440a9b56 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:29.569846 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-85d1ac5e-530a-4cb6-b0e2-e947440a9b56 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:29.702437 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-85d1ac5e-530a-4cb6-b0e2-e947440a9b56 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:29.709847 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-85d1ac5e-530a-4cb6-b0e2-e947440a9b56 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1266 microversion: 2.1 time: 0.154319 Aug 08 17:04:29.710405 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 625/1252] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:29 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:30.731295 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e167d4a7-3375-43ee-91a5-6ba579f79dda tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:30.732588 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e167d4a7-3375-43ee-91a5-6ba579f79dda tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:30.739161 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e167d4a7-3375-43ee-91a5-6ba579f79dda tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:30.739629 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e167d4a7-3375-43ee-91a5-6ba579f79dda tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:30.740058 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e167d4a7-3375-43ee-91a5-6ba579f79dda tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:30.740737 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e167d4a7-3375-43ee-91a5-6ba579f79dda tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:30.741180 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e167d4a7-3375-43ee-91a5-6ba579f79dda tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:30.741594 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-e167d4a7-3375-43ee-91a5-6ba579f79dda tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:30.878489 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e167d4a7-3375-43ee-91a5-6ba579f79dda tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:30.885888 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e167d4a7-3375-43ee-91a5-6ba579f79dda tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1266 microversion: 2.1 time: 0.158465 Aug 08 17:04:30.886450 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 628/1253] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:30 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:31.058956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-55626586-bc04-4a66-9718-8197a93caea1 req-16ebc66d-4842-4396-bc8c-2ff8c3ae5f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622725fc-56b2-4713-b7ff-8f52c495c402", "name": "network-vif-plugged", "status": "completed", "tag": "0fc25895-0d3b-46b3-b004-b2fd801884d4"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:31.067118 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-55626586-bc04-4a66-9718-8197a93caea1 req-16ebc66d-4842-4396-bc8c-2ff8c3ae5f20 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:31.067591 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-55626586-bc04-4a66-9718-8197a93caea1 req-16ebc66d-4842-4396-bc8c-2ff8c3ae5f20 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:31.068049 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-55626586-bc04-4a66-9718-8197a93caea1 req-16ebc66d-4842-4396-bc8c-2ff8c3ae5f20 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:31.079275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-55626586-bc04-4a66-9718-8197a93caea1 req-16ebc66d-4842-4396-bc8c-2ff8c3ae5f20 service nova] Creating event network-vif-plugged:0fc25895-0d3b-46b3-b004-b2fd801884d4 for instance 622725fc-56b2-4713-b7ff-8f52c495c402 on hv-cinder-85220 Aug 08 17:04:31.084185 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-55626586-bc04-4a66-9718-8197a93caea1 req-16ebc66d-4842-4396-bc8c-2ff8c3ae5f20 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092367 Aug 08 17:04:31.088212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 626/1254] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:04:31.905746 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4fb06f65-8032-451f-8182-dfd515dddcb3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:31.906342 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4fb06f65-8032-451f-8182-dfd515dddcb3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:31.912785 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4fb06f65-8032-451f-8182-dfd515dddcb3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:31.913265 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4fb06f65-8032-451f-8182-dfd515dddcb3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:31.913695 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4fb06f65-8032-451f-8182-dfd515dddcb3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:31.914378 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4fb06f65-8032-451f-8182-dfd515dddcb3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:31.914854 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4fb06f65-8032-451f-8182-dfd515dddcb3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:31.915281 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4fb06f65-8032-451f-8182-dfd515dddcb3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:32.048744 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4fb06f65-8032-451f-8182-dfd515dddcb3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:32.056156 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4fb06f65-8032-451f-8182-dfd515dddcb3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1266 microversion: 2.1 time: 0.154283 Aug 08 17:04:32.056718 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 629/1255] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:31 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:33.078654 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-1e144d43-046c-40f5-b79f-86bc40749b3b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:33.079387 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-1e144d43-046c-40f5-b79f-86bc40749b3b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:33.085736 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1e144d43-046c-40f5-b79f-86bc40749b3b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:33.086224 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1e144d43-046c-40f5-b79f-86bc40749b3b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:33.086683 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1e144d43-046c-40f5-b79f-86bc40749b3b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:33.087370 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1e144d43-046c-40f5-b79f-86bc40749b3b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:33.087826 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1e144d43-046c-40f5-b79f-86bc40749b3b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:33.088249 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-1e144d43-046c-40f5-b79f-86bc40749b3b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:33.219238 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-1e144d43-046c-40f5-b79f-86bc40749b3b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:33.226816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-1e144d43-046c-40f5-b79f-86bc40749b3b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1452 microversion: 2.1 time: 0.153739 Aug 08 17:04:33.227382 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 627/1256] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:33 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:33.246311 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-004d3341-348f-41de-8551-09e7b61f01d0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:04:33.247466 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-004d3341-348f-41de-8551-09e7b61f01d0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:04:33.253954 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-004d3341-348f-41de-8551-09e7b61f01d0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:33.254435 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-004d3341-348f-41de-8551-09e7b61f01d0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:33.254917 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-004d3341-348f-41de-8551-09e7b61f01d0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:33.255608 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-004d3341-348f-41de-8551-09e7b61f01d0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:33.256062 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-004d3341-348f-41de-8551-09e7b61f01d0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:33.256496 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-004d3341-348f-41de-8551-09e7b61f01d0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:33.390319 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-004d3341-348f-41de-8551-09e7b61f01d0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:04:33.396084 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-004d3341-348f-41de-8551-09e7b61f01d0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1452 microversion: 2.1 time: 0.153511 Aug 08 17:04:33.396677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 630/1257] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:04:33 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:04:35.448640 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-dcca02d0-f277-4514-ae4f-3ddfb973c248 req-d67b0285-9e16-4c4c-9d6b-e7dda941d771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "622725fc-56b2-4713-b7ff-8f52c495c402", "tag": "0fc25895-0d3b-46b3-b004-b2fd801884d4"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:04:35.460097 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-dcca02d0-f277-4514-ae4f-3ddfb973c248 req-d67b0285-9e16-4c4c-9d6b-e7dda941d771 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:04:35.460582 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-dcca02d0-f277-4514-ae4f-3ddfb973c248 req-d67b0285-9e16-4c4c-9d6b-e7dda941d771 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:04:35.461012 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-dcca02d0-f277-4514-ae4f-3ddfb973c248 req-d67b0285-9e16-4c4c-9d6b-e7dda941d771 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:04:35.473111 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-dcca02d0-f277-4514-ae4f-3ddfb973c248 req-d67b0285-9e16-4c4c-9d6b-e7dda941d771 service nova] Creating event network-changed:0fc25895-0d3b-46b3-b004-b2fd801884d4 for instance 622725fc-56b2-4713-b7ff-8f52c495c402 on hv-cinder-85220 Aug 08 17:04:35.478171 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-dcca02d0-f277-4514-ae4f-3ddfb973c248 req-d67b0285-9e16-4c4c-9d6b-e7dda941d771 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032998 Aug 08 17:04:35.478840 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 628/1258] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:30.632651 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2151b35b-482a-402a-8977-9b196efbb294] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 08 17:06:30.633477 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=22 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:30.634231 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=54 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:30.638146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4a6c1e90-11f0-4759-bd11-eee4fcd12e66 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:30.638682 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4a6c1e90-11f0-4759-bd11-eee4fcd12e66 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:30.644424 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a6c1e90-11f0-4759-bd11-eee4fcd12e66 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:30.644905 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a6c1e90-11f0-4759-bd11-eee4fcd12e66 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:30.645344 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a6c1e90-11f0-4759-bd11-eee4fcd12e66 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:30.646031 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a6c1e90-11f0-4759-bd11-eee4fcd12e66 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:30.646484 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a6c1e90-11f0-4759-bd11-eee4fcd12e66 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:30.647719 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4a6c1e90-11f0-4759-bd11-eee4fcd12e66 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:30.672234 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4a6c1e90-11f0-4759-bd11-eee4fcd12e66 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:06:30.977306 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4a6c1e90-11f0-4759-bd11-eee4fcd12e66 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "DELETE /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 204 len: 0 microversion: 2.1 time: 0.347036 Aug 08 17:06:30.977910 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 631/1259] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:06:30 2022] DELETE /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 17:06:30.984336 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b91ecbcf-456f-4c1b-9104-dc48b5a0bf50] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 08 17:06:30.986074 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:30.986074 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=44 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:30.990319 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-738ced73-e2ae-4d63-bdf5-86359e57afa5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:30.991552 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-738ced73-e2ae-4d63-bdf5-86359e57afa5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:30.997716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-738ced73-e2ae-4d63-bdf5-86359e57afa5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:30.998199 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-738ced73-e2ae-4d63-bdf5-86359e57afa5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:30.998660 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-738ced73-e2ae-4d63-bdf5-86359e57afa5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:30.999367 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-738ced73-e2ae-4d63-bdf5-86359e57afa5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:30.999920 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-738ced73-e2ae-4d63-bdf5-86359e57afa5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:31.000239 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-738ced73-e2ae-4d63-bdf5-86359e57afa5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:31.143369 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-738ced73-e2ae-4d63-bdf5-86359e57afa5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:31.152333 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-738ced73-e2ae-4d63-bdf5-86359e57afa5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1576 microversion: 2.1 time: 0.169983 Aug 08 17:06:31.152896 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 629/1260] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:30 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:32.175190 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-8571ef82-f516-4e31-900e-ae33ae06739f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:32.175897 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-8571ef82-f516-4e31-900e-ae33ae06739f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:32.187596 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8571ef82-f516-4e31-900e-ae33ae06739f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:32.188131 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8571ef82-f516-4e31-900e-ae33ae06739f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:32.188684 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8571ef82-f516-4e31-900e-ae33ae06739f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:32.189484 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8571ef82-f516-4e31-900e-ae33ae06739f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:32.189977 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8571ef82-f516-4e31-900e-ae33ae06739f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:32.190547 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-8571ef82-f516-4e31-900e-ae33ae06739f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:32.208211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO oslo.messaging._drivers.impl_rabbit [-] [2151b35b-482a-402a-8977-9b196efbb294] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 38024. Aug 08 17:06:32.332764 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-8571ef82-f516-4e31-900e-ae33ae06739f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:32.341538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-8571ef82-f516-4e31-900e-ae33ae06739f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1576 microversion: 2.1 time: 0.170637 Aug 08 17:06:32.342113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 632/1261] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:32 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:33.363075 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-9a9abf04-c7b1-4d49-ae60-08391a42f394 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:33.363725 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-9a9abf04-c7b1-4d49-ae60-08391a42f394 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:33.371924 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9a9abf04-c7b1-4d49-ae60-08391a42f394 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:33.372416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9a9abf04-c7b1-4d49-ae60-08391a42f394 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:33.372857 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9a9abf04-c7b1-4d49-ae60-08391a42f394 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:33.373595 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9a9abf04-c7b1-4d49-ae60-08391a42f394 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:33.374050 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9a9abf04-c7b1-4d49-ae60-08391a42f394 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:33.374473 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-9a9abf04-c7b1-4d49-ae60-08391a42f394 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:33.394659 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO oslo.messaging._drivers.impl_rabbit [-] [b91ecbcf-456f-4c1b-9104-dc48b5a0bf50] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 38030. Aug 08 17:06:33.465007 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-9a9abf04-c7b1-4d49-ae60-08391a42f394 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:33.471010 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-9a9abf04-c7b1-4d49-ae60-08391a42f394 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1509 microversion: 2.1 time: 0.111853 Aug 08 17:06:33.471960 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 630/1262] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:33 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1509 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:33.543003 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-6f939a68-a878-475c-a882-02482ee7aa08 req-1cd5c1f3-5142-4ca1-bd63-1f2f4e66617e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622725fc-56b2-4713-b7ff-8f52c495c402", "name": "network-vif-deleted", "tag": "0fc25895-0d3b-46b3-b004-b2fd801884d4"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:06:33.553335 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-6f939a68-a878-475c-a882-02482ee7aa08 req-1cd5c1f3-5142-4ca1-bd63-1f2f4e66617e service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:33.554061 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-6f939a68-a878-475c-a882-02482ee7aa08 req-1cd5c1f3-5142-4ca1-bd63-1f2f4e66617e service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:33.554849 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-6f939a68-a878-475c-a882-02482ee7aa08 req-1cd5c1f3-5142-4ca1-bd63-1f2f4e66617e service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:33.567693 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-6f939a68-a878-475c-a882-02482ee7aa08 req-1cd5c1f3-5142-4ca1-bd63-1f2f4e66617e service nova] Creating event network-vif-deleted:0fc25895-0d3b-46b3-b004-b2fd801884d4 for instance 622725fc-56b2-4713-b7ff-8f52c495c402 on hv-cinder-85220 Aug 08 17:06:33.574929 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-6f939a68-a878-475c-a882-02482ee7aa08 req-1cd5c1f3-5142-4ca1-bd63-1f2f4e66617e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035343 Aug 08 17:06:33.575722 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 633/1263] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:34.494424 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:34.495172 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:34.501587 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:34.502101 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:34.502531 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:34.503243 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:34.503691 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:34.504110 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:34.536132 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:34.536609 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:34.537037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:34.537966 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.objects.instance [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lazy-loading 'fault' on Instance uuid 622725fc-56b2-4713-b7ff-8f52c495c402 {{(pid=130235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 17:06:34.579905 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:34.588284 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-f068ecda-574e-4429-beca-84e451db20a3 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 200 len: 1231 microversion: 2.1 time: 0.098991 Aug 08 17:06:34.591841 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 631/1264] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:34 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:35.609930 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-040fe4bf-8f87-4933-adcd-3bb1763f303f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:35.610792 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-040fe4bf-8f87-4933-adcd-3bb1763f303f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:35.617054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-040fe4bf-8f87-4933-adcd-3bb1763f303f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:35.617523 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-040fe4bf-8f87-4933-adcd-3bb1763f303f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:35.617955 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-040fe4bf-8f87-4933-adcd-3bb1763f303f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:35.618665 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-040fe4bf-8f87-4933-adcd-3bb1763f303f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:35.619116 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-040fe4bf-8f87-4933-adcd-3bb1763f303f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:35.619535 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-040fe4bf-8f87-4933-adcd-3bb1763f303f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:35.635509 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-040fe4bf-8f87-4933-adcd-3bb1763f303f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] HTTP exception thrown: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-040fe4bf-8f87-4933-adcd-3bb1763f303f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Request method failure captured: Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 HTTP/1.1 Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8UH0eoXDfbkju0gxWBu5sD0ewra8m2060haz0mGs7uraa9NTYzirDS8qCjCpK8NhOkC_Kx7_bxKeQEPuzSFJLNXqcW7CWkmepH_OhVaEGkODQJOihKpE0RpmomyJevWhSAlzGy3N6EDEKMRdQqf7mTTDzjBOu_wtEiTjceiiiqotqzw Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: f30f18b2d4fe4a9fa54fce853aa4c5cf Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 17:06:35.637113 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 17:06:35.639057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f30f18b2d4fe4a9fa54fce853aa4c5cf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:06:35.639057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:06:35.639057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: f30f18b2d4fe4a9fa54fce853aa4c5cf Aug 08 17:06:35.639057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:06:35.639057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-TestVolumeBootPattern-1721055160-project Aug 08 17:06:35.639057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 17:06:35.639057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 17:06:35.639057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: bd48464ff95749cd8b36b2fea90ddb31 Aug 08 17:06:35.639057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-TestVolumeBootPattern-1721055160-project Aug 08 17:06:35.639057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 17:06:35.639057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:06:35.639057 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': '622725fc-56b2-4713-b7ff-8f52c495c402'} Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:06:35.640073 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:06:35.641533 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:06:35.642883 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-040fe4bf-8f87-4933-adcd-3bb1763f303f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Returning 404 to user: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:06:35.642883 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-040fe4bf-8f87-4933-adcd-3bb1763f303f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 404 len: 111 microversion: 2.1 time: 0.033272 Aug 08 17:06:35.642883 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 634/1265] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:35 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:06:35.686861 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2062432145", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1799878524", "security_groups": [{"name": "tempest-secgroup-smoke-418551888"}], "block_device_mapping_v2": [{"uuid": "e0cf6664-a2c3-4283-b4fc-b44478b75d15", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0928dfca-2889-483b-a2d3-f6a5fb21fcb6"}]}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:06:35.800398 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.network.neutron [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] validate_networks() for [('0928dfca-2889-483b-a2d3-f6a5fb21fcb6', None, None, None, None, None)] {{(pid=130235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:06:36.183486 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Flavor limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:06:36.183833 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Image limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:06:36.184313 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Flavor pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:06:36.184726 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Image pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:06:36.185147 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:06:36.194239 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:36.194904 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:36.195364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:36.196110 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:36.196587 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:36.197010 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:36.214124 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Getting quotas for project f30f18b2d4fe4a9fa54fce853aa4c5cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:06:36.218397 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Getting quotas for user bd48464ff95749cd8b36b2fea90ddb31 and project f30f18b2d4fe4a9fa54fce853aa4c5cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:06:36.277113 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Going to run 1 instances... {{(pid=130235) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:06:36.279277 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0cf6664-a2c3-4283-b4fc-b44478b75d15',volume_size=None,volume_type=None)] {{(pid=130235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:06:36.647411 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-7aaed050-90c9-4cf1-82fc-c04dbfe4b413 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.964318 Aug 08 17:06:36.649050 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 632/1266] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 17:06:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:06:36.660305 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-6e8dc269-a097-49b4-946f-2909e23f8a73 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:36.661046 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-6e8dc269-a097-49b4-946f-2909e23f8a73 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:36.717468 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-6e8dc269-a097-49b4-946f-2909e23f8a73 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:36.724491 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-6e8dc269-a097-49b4-946f-2909e23f8a73 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1095 microversion: 2.1 time: 0.068222 Aug 08 17:06:36.725069 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 635/1267] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:36 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:37.749280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-97c21b48-8eaa-42ea-b901-bbbcb8a244d9 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:37.749280 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-97c21b48-8eaa-42ea-b901-bbbcb8a244d9 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:38.056760 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-97c21b48-8eaa-42ea-b901-bbbcb8a244d9 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:38.063531 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-97c21b48-8eaa-42ea-b901-bbbcb8a244d9 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1095 microversion: 2.1 time: 0.321397 Aug 08 17:06:38.064092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 633/1268] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:37 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1095 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:39.084434 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-e0631d44-d925-41ad-8263-d0dd993e2c54 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:39.085876 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-e0631d44-d925-41ad-8263-d0dd993e2c54 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:39.140608 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-e0631d44-d925-41ad-8263-d0dd993e2c54 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:39.147558 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-e0631d44-d925-41ad-8263-d0dd993e2c54 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1095 microversion: 2.1 time: 0.067072 Aug 08 17:06:39.148143 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 636/1269] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:39 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:40.167582 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-18c12d61-5423-4920-8d2f-d42af433d0a2 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:40.168234 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-18c12d61-5423-4920-8d2f-d42af433d0a2 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:40.223894 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-18c12d61-5423-4920-8d2f-d42af433d0a2 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:40.231076 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-18c12d61-5423-4920-8d2f-d42af433d0a2 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1095 microversion: 2.1 time: 0.067390 Aug 08 17:06:40.231728 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 634/1270] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:40 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:41.251565 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-fd4dae19-98ad-4fff-ab54-7ecd4c759438 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:41.252172 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-fd4dae19-98ad-4fff-ab54-7ecd4c759438 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:41.258887 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd4dae19-98ad-4fff-ab54-7ecd4c759438 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:41.259962 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd4dae19-98ad-4fff-ab54-7ecd4c759438 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:41.261003 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd4dae19-98ad-4fff-ab54-7ecd4c759438 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:41.261708 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd4dae19-98ad-4fff-ab54-7ecd4c759438 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:41.262157 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd4dae19-98ad-4fff-ab54-7ecd4c759438 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:41.263629 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-fd4dae19-98ad-4fff-ab54-7ecd4c759438 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:41.325353 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-fd4dae19-98ad-4fff-ab54-7ecd4c759438 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:41.333588 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-fd4dae19-98ad-4fff-ab54-7ecd4c759438 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1145 microversion: 2.1 time: 0.085944 Aug 08 17:06:41.334161 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 637/1271] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:41 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:42.355685 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2eba95ee-6ec6-4bc8-ad02-3e9e069cc4fe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:42.356705 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2eba95ee-6ec6-4bc8-ad02-3e9e069cc4fe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:42.363424 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2eba95ee-6ec6-4bc8-ad02-3e9e069cc4fe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:42.363908 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2eba95ee-6ec6-4bc8-ad02-3e9e069cc4fe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:42.364350 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2eba95ee-6ec6-4bc8-ad02-3e9e069cc4fe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:42.365052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2eba95ee-6ec6-4bc8-ad02-3e9e069cc4fe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:42.365830 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2eba95ee-6ec6-4bc8-ad02-3e9e069cc4fe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:42.365958 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2eba95ee-6ec6-4bc8-ad02-3e9e069cc4fe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:42.443236 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-2eba95ee-6ec6-4bc8-ad02-3e9e069cc4fe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:42.451743 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2eba95ee-6ec6-4bc8-ad02-3e9e069cc4fe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1193 microversion: 2.1 time: 0.101354 Aug 08 17:06:42.452324 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 635/1272] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:42 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:43.473052 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-a983b2ee-79d9-4b53-a5cf-8afc9b8b03eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:43.474419 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-a983b2ee-79d9-4b53-a5cf-8afc9b8b03eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:43.482547 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a983b2ee-79d9-4b53-a5cf-8afc9b8b03eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:43.483105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a983b2ee-79d9-4b53-a5cf-8afc9b8b03eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:43.483588 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a983b2ee-79d9-4b53-a5cf-8afc9b8b03eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:43.484276 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a983b2ee-79d9-4b53-a5cf-8afc9b8b03eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:43.484793 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a983b2ee-79d9-4b53-a5cf-8afc9b8b03eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:43.485142 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-a983b2ee-79d9-4b53-a5cf-8afc9b8b03eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:43.659781 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-a983b2ee-79d9-4b53-a5cf-8afc9b8b03eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:43.670928 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-a983b2ee-79d9-4b53-a5cf-8afc9b8b03eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1278 microversion: 2.1 time: 0.201778 Aug 08 17:06:43.671631 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 638/1273] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:43 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1278 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:06:44.390592 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-79c6471d-30f9-48b9-87e8-b0d4ab4ff90c req-5bdb9896-504c-4d17-8bca-421c8501b196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b3cda4-6c2b-4fc9-b300-6e5d65027cf5", "tag": "53165425-ada3-43b2-b6f7-01399a8c3ebc"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:06:44.402001 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-79c6471d-30f9-48b9-87e8-b0d4ab4ff90c req-5bdb9896-504c-4d17-8bca-421c8501b196 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:44.402476 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-79c6471d-30f9-48b9-87e8-b0d4ab4ff90c req-5bdb9896-504c-4d17-8bca-421c8501b196 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:44.402940 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-79c6471d-30f9-48b9-87e8-b0d4ab4ff90c req-5bdb9896-504c-4d17-8bca-421c8501b196 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:44.414522 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-79c6471d-30f9-48b9-87e8-b0d4ab4ff90c req-5bdb9896-504c-4d17-8bca-421c8501b196 service nova] Creating event network-changed:53165425-ada3-43b2-b6f7-01399a8c3ebc for instance 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 on hv-cinder-85220 Aug 08 17:06:44.420783 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-79c6471d-30f9-48b9-87e8-b0d4ab4ff90c req-5bdb9896-504c-4d17-8bca-421c8501b196 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036095 Aug 08 17:06:44.421469 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 636/1274] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:44.693022 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-b2fecf37-63e4-4545-bedd-8f1aa07c3d19 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:44.693756 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-b2fecf37-63e4-4545-bedd-8f1aa07c3d19 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:44.700725 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b2fecf37-63e4-4545-bedd-8f1aa07c3d19 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:44.701218 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b2fecf37-63e4-4545-bedd-8f1aa07c3d19 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:44.701653 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b2fecf37-63e4-4545-bedd-8f1aa07c3d19 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:44.702371 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b2fecf37-63e4-4545-bedd-8f1aa07c3d19 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:44.702850 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b2fecf37-63e4-4545-bedd-8f1aa07c3d19 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:44.703284 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-b2fecf37-63e4-4545-bedd-8f1aa07c3d19 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:44.840410 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-b2fecf37-63e4-4545-bedd-8f1aa07c3d19 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:44.847984 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-b2fecf37-63e4-4545-bedd-8f1aa07c3d19 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1266 microversion: 2.1 time: 0.158821 Aug 08 17:06:44.848482 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 639/1275] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:44 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:45.871460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-5007b282-1c31-4d25-a8a3-e0d267342e91 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:45.872155 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-5007b282-1c31-4d25-a8a3-e0d267342e91 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:45.878219 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5007b282-1c31-4d25-a8a3-e0d267342e91 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:45.878732 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5007b282-1c31-4d25-a8a3-e0d267342e91 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:45.879195 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5007b282-1c31-4d25-a8a3-e0d267342e91 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:45.879878 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5007b282-1c31-4d25-a8a3-e0d267342e91 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:45.880324 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5007b282-1c31-4d25-a8a3-e0d267342e91 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:45.880741 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-5007b282-1c31-4d25-a8a3-e0d267342e91 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:46.021426 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-5007b282-1c31-4d25-a8a3-e0d267342e91 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:46.029129 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-5007b282-1c31-4d25-a8a3-e0d267342e91 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1266 microversion: 2.1 time: 0.163082 Aug 08 17:06:46.029697 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 637/1276] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:45 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:47.049421 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-263a8e5e-7751-469d-b4bb-1c3cd661d9c4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:47.050056 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-263a8e5e-7751-469d-b4bb-1c3cd661d9c4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:47.057746 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-263a8e5e-7751-469d-b4bb-1c3cd661d9c4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:47.058229 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-263a8e5e-7751-469d-b4bb-1c3cd661d9c4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:47.058694 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-263a8e5e-7751-469d-b4bb-1c3cd661d9c4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:47.059400 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-263a8e5e-7751-469d-b4bb-1c3cd661d9c4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:47.059845 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-263a8e5e-7751-469d-b4bb-1c3cd661d9c4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:47.060272 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-263a8e5e-7751-469d-b4bb-1c3cd661d9c4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:47.245873 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-263a8e5e-7751-469d-b4bb-1c3cd661d9c4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:47.253347 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-263a8e5e-7751-469d-b4bb-1c3cd661d9c4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1266 microversion: 2.1 time: 0.207772 Aug 08 17:06:47.253904 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 640/1277] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:47 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:48.273634 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-a6a49430-d6c3-412e-8262-fb7d6ca19b39 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:48.274212 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-a6a49430-d6c3-412e-8262-fb7d6ca19b39 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:48.276710 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:48.282097 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a6a49430-d6c3-412e-8262-fb7d6ca19b39 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:48.285678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a6a49430-d6c3-412e-8262-fb7d6ca19b39 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:48.285678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a6a49430-d6c3-412e-8262-fb7d6ca19b39 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:48.285678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a6a49430-d6c3-412e-8262-fb7d6ca19b39 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:48.285678 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a6a49430-d6c3-412e-8262-fb7d6ca19b39 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:48.286080 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-a6a49430-d6c3-412e-8262-fb7d6ca19b39 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:48.491844 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-a6a49430-d6c3-412e-8262-fb7d6ca19b39 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:48.500372 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-a6a49430-d6c3-412e-8262-fb7d6ca19b39 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1266 microversion: 2.1 time: 0.230677 Aug 08 17:06:48.500951 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 638/1278] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:48 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:49.521051 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ef1762da-c0e6-4334-85d8-ce2b11443f7f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:49.521619 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ef1762da-c0e6-4334-85d8-ce2b11443f7f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:49.524081 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=4 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:49.529041 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ef1762da-c0e6-4334-85d8-ce2b11443f7f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:49.537251 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ef1762da-c0e6-4334-85d8-ce2b11443f7f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:49.537251 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ef1762da-c0e6-4334-85d8-ce2b11443f7f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:49.537251 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ef1762da-c0e6-4334-85d8-ce2b11443f7f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:49.537251 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ef1762da-c0e6-4334-85d8-ce2b11443f7f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:49.537806 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ef1762da-c0e6-4334-85d8-ce2b11443f7f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:49.662481 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ef1762da-c0e6-4334-85d8-ce2b11443f7f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:49.671137 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ef1762da-c0e6-4334-85d8-ce2b11443f7f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1266 microversion: 2.1 time: 0.154096 Aug 08 17:06:49.671704 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 641/1279] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:49 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:50.692173 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b9203c7f-dfb0-4774-84d4-325a63214efb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:50.692784 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b9203c7f-dfb0-4774-84d4-325a63214efb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:50.695026 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=10 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:06:50.700699 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b9203c7f-dfb0-4774-84d4-325a63214efb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:50.709257 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b9203c7f-dfb0-4774-84d4-325a63214efb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:50.709257 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b9203c7f-dfb0-4774-84d4-325a63214efb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:50.709257 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b9203c7f-dfb0-4774-84d4-325a63214efb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:50.709257 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b9203c7f-dfb0-4774-84d4-325a63214efb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:50.709645 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b9203c7f-dfb0-4774-84d4-325a63214efb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:50.836477 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b9203c7f-dfb0-4774-84d4-325a63214efb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:50.844863 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b9203c7f-dfb0-4774-84d4-325a63214efb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1266 microversion: 2.1 time: 0.156539 Aug 08 17:06:50.845518 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 639/1280] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:50 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:51.865345 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-78fbae36-48cc-485e-843b-a6b0abe984ef tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:51.865990 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-78fbae36-48cc-485e-843b-a6b0abe984ef tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:51.873060 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78fbae36-48cc-485e-843b-a6b0abe984ef tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:51.873544 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78fbae36-48cc-485e-843b-a6b0abe984ef tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:51.873986 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78fbae36-48cc-485e-843b-a6b0abe984ef tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:51.874703 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78fbae36-48cc-485e-843b-a6b0abe984ef tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:51.875159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78fbae36-48cc-485e-843b-a6b0abe984ef tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:51.875580 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-78fbae36-48cc-485e-843b-a6b0abe984ef tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:52.015454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-78fbae36-48cc-485e-843b-a6b0abe984ef tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:52.022986 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-78fbae36-48cc-485e-843b-a6b0abe984ef tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1266 microversion: 2.1 time: 0.161667 Aug 08 17:06:52.023559 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 642/1281] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:51 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:53.044960 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e098d4d5-e188-4d1e-8e62-463eed3e6358 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:53.045598 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e098d4d5-e188-4d1e-8e62-463eed3e6358 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:53.052165 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e098d4d5-e188-4d1e-8e62-463eed3e6358 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:53.052652 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e098d4d5-e188-4d1e-8e62-463eed3e6358 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:53.053079 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e098d4d5-e188-4d1e-8e62-463eed3e6358 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:53.053762 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e098d4d5-e188-4d1e-8e62-463eed3e6358 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:53.054208 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e098d4d5-e188-4d1e-8e62-463eed3e6358 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:53.054651 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e098d4d5-e188-4d1e-8e62-463eed3e6358 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:53.190695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e098d4d5-e188-4d1e-8e62-463eed3e6358 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:53.198883 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e098d4d5-e188-4d1e-8e62-463eed3e6358 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1266 microversion: 2.1 time: 0.158642 Aug 08 17:06:53.199447 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 640/1282] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:53 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:54.219230 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-60470009-6cd1-47c0-aa79-2beaba4a4cd0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:54.219926 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-60470009-6cd1-47c0-aa79-2beaba4a4cd0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:54.226339 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-60470009-6cd1-47c0-aa79-2beaba4a4cd0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:54.226856 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-60470009-6cd1-47c0-aa79-2beaba4a4cd0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:54.227295 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-60470009-6cd1-47c0-aa79-2beaba4a4cd0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:54.228105 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-60470009-6cd1-47c0-aa79-2beaba4a4cd0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:54.228767 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-60470009-6cd1-47c0-aa79-2beaba4a4cd0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:54.229196 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-60470009-6cd1-47c0-aa79-2beaba4a4cd0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:54.362959 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-60470009-6cd1-47c0-aa79-2beaba4a4cd0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:54.371134 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-60470009-6cd1-47c0-aa79-2beaba4a4cd0 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1266 microversion: 2.1 time: 0.155782 Aug 08 17:06:54.371706 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 643/1283] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:54 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:55.392157 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8d07a70b-9417-41d6-8a3f-6db4fcf0b057 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:55.392791 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8d07a70b-9417-41d6-8a3f-6db4fcf0b057 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:55.399170 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d07a70b-9417-41d6-8a3f-6db4fcf0b057 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:55.400438 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d07a70b-9417-41d6-8a3f-6db4fcf0b057 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:55.401103 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d07a70b-9417-41d6-8a3f-6db4fcf0b057 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:55.401843 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d07a70b-9417-41d6-8a3f-6db4fcf0b057 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:55.402296 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d07a70b-9417-41d6-8a3f-6db4fcf0b057 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:55.402745 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8d07a70b-9417-41d6-8a3f-6db4fcf0b057 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:55.538093 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8d07a70b-9417-41d6-8a3f-6db4fcf0b057 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:55.546677 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8d07a70b-9417-41d6-8a3f-6db4fcf0b057 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1266 microversion: 2.1 time: 0.158223 Aug 08 17:06:55.547078 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 641/1284] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:55 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:55.727637 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-8f5f77b6-f005-46c5-bf7e-d87774d6ea3a req-97c85f6b-577c-4c36-aa6a-fce194c3dc1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b3cda4-6c2b-4fc9-b300-6e5d65027cf5", "name": "network-vif-plugged", "status": "completed", "tag": "53165425-ada3-43b2-b6f7-01399a8c3ebc"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:06:55.740431 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-8f5f77b6-f005-46c5-bf7e-d87774d6ea3a req-97c85f6b-577c-4c36-aa6a-fce194c3dc1c service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:55.741169 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-8f5f77b6-f005-46c5-bf7e-d87774d6ea3a req-97c85f6b-577c-4c36-aa6a-fce194c3dc1c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:55.741741 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-8f5f77b6-f005-46c5-bf7e-d87774d6ea3a req-97c85f6b-577c-4c36-aa6a-fce194c3dc1c service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:55.756448 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-8f5f77b6-f005-46c5-bf7e-d87774d6ea3a req-97c85f6b-577c-4c36-aa6a-fce194c3dc1c service nova] Creating event network-vif-plugged:53165425-ada3-43b2-b6f7-01399a8c3ebc for instance 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 on hv-cinder-85220 Aug 08 17:06:55.763708 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-8f5f77b6-f005-46c5-bf7e-d87774d6ea3a req-97c85f6b-577c-4c36-aa6a-fce194c3dc1c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042644 Aug 08 17:06:55.764485 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 644/1285] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:06:56.567032 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-3d48048f-1f87-4fa6-8493-6d7bec00a934 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:56.567601 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-3d48048f-1f87-4fa6-8493-6d7bec00a934 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:56.574915 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3d48048f-1f87-4fa6-8493-6d7bec00a934 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:56.575460 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3d48048f-1f87-4fa6-8493-6d7bec00a934 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:56.575872 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3d48048f-1f87-4fa6-8493-6d7bec00a934 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:56.576610 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3d48048f-1f87-4fa6-8493-6d7bec00a934 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:56.577052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3d48048f-1f87-4fa6-8493-6d7bec00a934 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:56.577516 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-3d48048f-1f87-4fa6-8493-6d7bec00a934 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:56.715020 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-3d48048f-1f87-4fa6-8493-6d7bec00a934 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:56.722813 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-3d48048f-1f87-4fa6-8493-6d7bec00a934 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1266 microversion: 2.1 time: 0.159624 Aug 08 17:06:56.723395 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 642/1286] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:56 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:57.744491 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-5f130d82-d2ad-486e-a493-1f7afbf18d60 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:57.745192 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-5f130d82-d2ad-486e-a493-1f7afbf18d60 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:57.751733 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5f130d82-d2ad-486e-a493-1f7afbf18d60 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:57.752217 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5f130d82-d2ad-486e-a493-1f7afbf18d60 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:57.752650 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5f130d82-d2ad-486e-a493-1f7afbf18d60 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:57.753437 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5f130d82-d2ad-486e-a493-1f7afbf18d60 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:57.753887 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5f130d82-d2ad-486e-a493-1f7afbf18d60 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:57.754307 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-5f130d82-d2ad-486e-a493-1f7afbf18d60 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:57.890268 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-5f130d82-d2ad-486e-a493-1f7afbf18d60 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:57.898071 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-5f130d82-d2ad-486e-a493-1f7afbf18d60 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1452 microversion: 2.1 time: 0.158139 Aug 08 17:06:57.903385 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 645/1287] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:57 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:06:57.919267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-ed225740-69f1-4c05-886a-f08047f92948 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:06:57.919934 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-ed225740-69f1-4c05-886a-f08047f92948 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:06:57.926695 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ed225740-69f1-4c05-886a-f08047f92948 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:57.927190 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ed225740-69f1-4c05-886a-f08047f92948 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:57.927762 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ed225740-69f1-4c05-886a-f08047f92948 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:57.928469 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ed225740-69f1-4c05-886a-f08047f92948 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:06:57.928925 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ed225740-69f1-4c05-886a-f08047f92948 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:06:57.929347 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-ed225740-69f1-4c05-886a-f08047f92948 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:06:58.063185 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-ed225740-69f1-4c05-886a-f08047f92948 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:06:58.070688 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-ed225740-69f1-4c05-886a-f08047f92948 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1452 microversion: 2.1 time: 0.155933 Aug 08 17:06:58.071400 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 643/1288] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:06:57 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:07:00.031600 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:07:00.032160 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Mon Aug 8 17:07:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:07:00.256092 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-aaae44b5-77ba-44d2-a4e9-2342002cf82f req-08bbb727-543e-4a1f-9d42-9ad97f7f932e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b3cda4-6c2b-4fc9-b300-6e5d65027cf5", "tag": "53165425-ada3-43b2-b6f7-01399a8c3ebc"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:07:00.266747 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-aaae44b5-77ba-44d2-a4e9-2342002cf82f req-08bbb727-543e-4a1f-9d42-9ad97f7f932e service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:07:00.267251 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-aaae44b5-77ba-44d2-a4e9-2342002cf82f req-08bbb727-543e-4a1f-9d42-9ad97f7f932e service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:07:00.267666 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-aaae44b5-77ba-44d2-a4e9-2342002cf82f req-08bbb727-543e-4a1f-9d42-9ad97f7f932e service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:07:00.279484 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-aaae44b5-77ba-44d2-a4e9-2342002cf82f req-08bbb727-543e-4a1f-9d42-9ad97f7f932e service nova] Creating event network-changed:53165425-ada3-43b2-b6f7-01399a8c3ebc for instance 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 on hv-cinder-85220 Aug 08 17:07:00.284791 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-aaae44b5-77ba-44d2-a4e9-2342002cf82f req-08bbb727-543e-4a1f-9d42-9ad97f7f932e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032350 Aug 08 17:07:00.287647 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 646/1289] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:07:05.075739 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:07:05.076397 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Mon Aug 8 17:07:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:08:35.009028 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:35.014697 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=72 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:35.014697 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2057683927", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1799878524", "security_groups": [{"name": "tempest-secgroup-smoke-418551888"}], "block_device_mapping_v2": [{"uuid": "4c1822a3-f096-4d46-93c6-c41b8388ad59", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0928dfca-2889-483b-a2d3-f6a5fb21fcb6"}]}} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:08:35.132242 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.network.neutron [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] validate_networks() for [('0928dfca-2889-483b-a2d3-f6a5fb21fcb6', None, None, None, None, None)] {{(pid=130235) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 17:08:35.506515 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Flavor limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 17:08:35.506956 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Image limits 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 17:08:35.507423 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Flavor pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 17:08:35.507854 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Image pref 0:0:0 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 17:08:35.508262 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.virt.hardware [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 17:08:35.516816 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:35.517285 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:35.517713 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:35.518428 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:35.519449 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:35.519867 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:35.537435 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Getting quotas for project f30f18b2d4fe4a9fa54fce853aa4c5cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 17:08:35.541643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.quota [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Getting quotas for user bd48464ff95749cd8b36b2fea90ddb31 and project f30f18b2d4fe4a9fa54fce853aa4c5cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130235) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 17:08:35.597805 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Going to run 1 instances... {{(pid=130235) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 17:08:35.600040 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4c1822a3-f096-4d46-93c6-c41b8388ad59',volume_size=None,volume_type=None)] {{(pid=130235) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 17:08:35.951209 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-2f66cf19-8fd8-4210-aade-bf46dc5dabfe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.943783 Aug 08 17:08:35.951776 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 644/1290] 10.222.0.13 () {60 vars in 1147 bytes} [Mon Aug 8 17:08:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 17:08:35.963219 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2151b35b-482a-402a-8977-9b196efbb294] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 08 17:08:35.963827 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:35.964721 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:35.969117 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-62d1762c-6582-4e32-9dbb-4d847ae4c619 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:35.969832 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-62d1762c-6582-4e32-9dbb-4d847ae4c619 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:36.032219 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-62d1762c-6582-4e32-9dbb-4d847ae4c619 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:36.039825 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-62d1762c-6582-4e32-9dbb-4d847ae4c619 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1095 microversion: 2.1 time: 0.079723 Aug 08 17:08:36.040397 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 647/1291] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:35 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:37.065000 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8e16ab6f-3db6-4405-a278-efec72709c1e tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:37.066765 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8e16ab6f-3db6-4405-a278-efec72709c1e tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:37.075650 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e16ab6f-3db6-4405-a278-efec72709c1e tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:37.076553 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e16ab6f-3db6-4405-a278-efec72709c1e tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:37.076553 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e16ab6f-3db6-4405-a278-efec72709c1e tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:37.077267 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e16ab6f-3db6-4405-a278-efec72709c1e tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:37.077714 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e16ab6f-3db6-4405-a278-efec72709c1e tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:37.078143 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8e16ab6f-3db6-4405-a278-efec72709c1e tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:37.142790 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-8e16ab6f-3db6-4405-a278-efec72709c1e tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:37.150711 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8e16ab6f-3db6-4405-a278-efec72709c1e tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1145 microversion: 2.1 time: 0.093145 Aug 08 17:08:37.151524 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 645/1292] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:37 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:38.175211 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-64aa5eb6-c928-4819-b1c6-d8f0b1a9ce8c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:38.176241 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-64aa5eb6-c928-4819-b1c6-d8f0b1a9ce8c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:38.191824 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO oslo.messaging._drivers.impl_rabbit [-] [2151b35b-482a-402a-8977-9b196efbb294] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 38220. Aug 08 17:08:38.196363 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-64aa5eb6-c928-4819-b1c6-d8f0b1a9ce8c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:38.197296 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-64aa5eb6-c928-4819-b1c6-d8f0b1a9ce8c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:38.197923 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-64aa5eb6-c928-4819-b1c6-d8f0b1a9ce8c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:38.199068 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-64aa5eb6-c928-4819-b1c6-d8f0b1a9ce8c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:38.199697 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-64aa5eb6-c928-4819-b1c6-d8f0b1a9ce8c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:38.200442 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-64aa5eb6-c928-4819-b1c6-d8f0b1a9ce8c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:38.269454 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-64aa5eb6-c928-4819-b1c6-d8f0b1a9ce8c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:38.277604 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-64aa5eb6-c928-4819-b1c6-d8f0b1a9ce8c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1211 microversion: 2.1 time: 0.108906 Aug 08 17:08:38.278206 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 648/1293] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:38 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:39.307022 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-289c97dd-8750-4a46-afda-1e3ac2613e03 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:39.307645 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-289c97dd-8750-4a46-afda-1e3ac2613e03 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:39.313793 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-289c97dd-8750-4a46-afda-1e3ac2613e03 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:39.314275 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-289c97dd-8750-4a46-afda-1e3ac2613e03 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:39.314740 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-289c97dd-8750-4a46-afda-1e3ac2613e03 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:39.315475 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-289c97dd-8750-4a46-afda-1e3ac2613e03 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:39.316547 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-289c97dd-8750-4a46-afda-1e3ac2613e03 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:39.317005 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-289c97dd-8750-4a46-afda-1e3ac2613e03 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:39.488904 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-289c97dd-8750-4a46-afda-1e3ac2613e03 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:39.496483 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-289c97dd-8750-4a46-afda-1e3ac2613e03 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1278 microversion: 2.1 time: 0.194025 Aug 08 17:08:39.497020 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 646/1294] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:39 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 17:08:39.907563 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-620819b9-20d1-4ac5-88f3-6d70cc3cfc79 req-cfcd1b0f-9812-43a0-935d-d12259591192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26af014-0153-4463-9afe-4be72de01b7c", "tag": "f64e465b-7cd7-43dc-8b14-7b4ddd29fa47"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:08:39.917660 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-620819b9-20d1-4ac5-88f3-6d70cc3cfc79 req-cfcd1b0f-9812-43a0-935d-d12259591192 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:39.918141 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-620819b9-20d1-4ac5-88f3-6d70cc3cfc79 req-cfcd1b0f-9812-43a0-935d-d12259591192 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:39.918600 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-620819b9-20d1-4ac5-88f3-6d70cc3cfc79 req-cfcd1b0f-9812-43a0-935d-d12259591192 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:39.930250 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-620819b9-20d1-4ac5-88f3-6d70cc3cfc79 req-cfcd1b0f-9812-43a0-935d-d12259591192 service nova] Creating event network-changed:f64e465b-7cd7-43dc-8b14-7b4ddd29fa47 for instance b26af014-0153-4463-9afe-4be72de01b7c on hv-cinder-85220 Aug 08 17:08:39.935570 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-620819b9-20d1-4ac5-88f3-6d70cc3cfc79 req-cfcd1b0f-9812-43a0-935d-d12259591192 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092764 Aug 08 17:08:39.936165 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 649/1295] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:08:40.517240 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-6e4de72a-542a-4a01-b923-9a73335680f4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:40.518085 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-6e4de72a-542a-4a01-b923-9a73335680f4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:40.524745 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e4de72a-542a-4a01-b923-9a73335680f4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:40.525229 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e4de72a-542a-4a01-b923-9a73335680f4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:40.525665 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e4de72a-542a-4a01-b923-9a73335680f4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:40.526369 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e4de72a-542a-4a01-b923-9a73335680f4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:40.527029 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e4de72a-542a-4a01-b923-9a73335680f4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:40.527462 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-6e4de72a-542a-4a01-b923-9a73335680f4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:40.739156 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-6e4de72a-542a-4a01-b923-9a73335680f4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:40.747020 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-6e4de72a-542a-4a01-b923-9a73335680f4 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1266 microversion: 2.1 time: 0.233696 Aug 08 17:08:40.747603 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 647/1296] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:40 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:41.769747 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-2cf1abe0-7fb9-4163-8d0b-501e12743ca8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:41.770526 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-2cf1abe0-7fb9-4163-8d0b-501e12743ca8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:41.777159 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2cf1abe0-7fb9-4163-8d0b-501e12743ca8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:41.777633 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2cf1abe0-7fb9-4163-8d0b-501e12743ca8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:41.778085 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2cf1abe0-7fb9-4163-8d0b-501e12743ca8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:41.778810 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2cf1abe0-7fb9-4163-8d0b-501e12743ca8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:41.779258 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2cf1abe0-7fb9-4163-8d0b-501e12743ca8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:41.779677 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-2cf1abe0-7fb9-4163-8d0b-501e12743ca8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:41.913331 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-2cf1abe0-7fb9-4163-8d0b-501e12743ca8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:41.921162 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-2cf1abe0-7fb9-4163-8d0b-501e12743ca8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1266 microversion: 2.1 time: 0.156401 Aug 08 17:08:41.921999 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 650/1297] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:41 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:42.942337 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-b70dc7d1-b8a4-4bb1-a509-0d81b253c3ff tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:42.943011 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-b70dc7d1-b8a4-4bb1-a509-0d81b253c3ff tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:42.949364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b70dc7d1-b8a4-4bb1-a509-0d81b253c3ff tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:42.949835 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b70dc7d1-b8a4-4bb1-a509-0d81b253c3ff tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:42.950264 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b70dc7d1-b8a4-4bb1-a509-0d81b253c3ff tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:42.950969 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b70dc7d1-b8a4-4bb1-a509-0d81b253c3ff tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:42.951416 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b70dc7d1-b8a4-4bb1-a509-0d81b253c3ff tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:42.951837 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-b70dc7d1-b8a4-4bb1-a509-0d81b253c3ff tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:43.084046 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-b70dc7d1-b8a4-4bb1-a509-0d81b253c3ff tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:43.091648 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-b70dc7d1-b8a4-4bb1-a509-0d81b253c3ff tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1266 microversion: 2.1 time: 0.153221 Aug 08 17:08:43.096611 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 648/1298] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:42 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:44.113894 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-955fde36-47e7-459b-8866-8683ca95c144 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:44.114490 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-955fde36-47e7-459b-8866-8683ca95c144 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:44.121111 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-955fde36-47e7-459b-8866-8683ca95c144 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:44.121598 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-955fde36-47e7-459b-8866-8683ca95c144 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:44.122041 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-955fde36-47e7-459b-8866-8683ca95c144 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:44.122814 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-955fde36-47e7-459b-8866-8683ca95c144 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:44.123274 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-955fde36-47e7-459b-8866-8683ca95c144 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:44.123701 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-955fde36-47e7-459b-8866-8683ca95c144 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:44.261146 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-955fde36-47e7-459b-8866-8683ca95c144 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:44.269114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-955fde36-47e7-459b-8866-8683ca95c144 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1266 microversion: 2.1 time: 0.159143 Aug 08 17:08:44.269833 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 651/1299] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:44 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:44.350441 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:08:44.351071 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Mon Aug 8 17:08:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:08:45.289933 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-e6f58321-e7f8-446e-8b9d-7f21c8906c3a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:45.290637 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-e6f58321-e7f8-446e-8b9d-7f21c8906c3a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:45.297072 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e6f58321-e7f8-446e-8b9d-7f21c8906c3a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:45.297550 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e6f58321-e7f8-446e-8b9d-7f21c8906c3a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:45.297978 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e6f58321-e7f8-446e-8b9d-7f21c8906c3a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:45.298690 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e6f58321-e7f8-446e-8b9d-7f21c8906c3a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:45.299137 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e6f58321-e7f8-446e-8b9d-7f21c8906c3a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:45.299555 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-e6f58321-e7f8-446e-8b9d-7f21c8906c3a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:45.433904 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-e6f58321-e7f8-446e-8b9d-7f21c8906c3a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:45.442594 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-e6f58321-e7f8-446e-8b9d-7f21c8906c3a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1266 microversion: 2.1 time: 0.156652 Aug 08 17:08:45.443168 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 649/1300] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:45 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:46.463555 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-4d6c6613-81a3-47de-b69a-6f56960ae078 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:46.469367 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-4d6c6613-81a3-47de-b69a-6f56960ae078 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:46.469367 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell0:SELECT=2 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:46.471442 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4d6c6613-81a3-47de-b69a-6f56960ae078 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:46.472157 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4d6c6613-81a3-47de-b69a-6f56960ae078 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:46.472596 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4d6c6613-81a3-47de-b69a-6f56960ae078 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:46.473292 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4d6c6613-81a3-47de-b69a-6f56960ae078 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:46.473743 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4d6c6613-81a3-47de-b69a-6f56960ae078 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:46.474167 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-4d6c6613-81a3-47de-b69a-6f56960ae078 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:46.608402 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-4d6c6613-81a3-47de-b69a-6f56960ae078 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:46.616568 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-4d6c6613-81a3-47de-b69a-6f56960ae078 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1266 microversion: 2.1 time: 0.157015 Aug 08 17:08:46.617138 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 652/1301] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:46 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:47.637742 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-fac4e05e-0f60-4534-a189-bc5e440dd084 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:47.638362 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-fac4e05e-0f60-4534-a189-bc5e440dd084 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:47.640198 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=2 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:47.640868 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell0:SELECT=6 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:08:47.646840 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fac4e05e-0f60-4534-a189-bc5e440dd084 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:47.651393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fac4e05e-0f60-4534-a189-bc5e440dd084 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:47.651393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fac4e05e-0f60-4534-a189-bc5e440dd084 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:47.651393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fac4e05e-0f60-4534-a189-bc5e440dd084 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:47.651393 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fac4e05e-0f60-4534-a189-bc5e440dd084 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:47.651884 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-fac4e05e-0f60-4534-a189-bc5e440dd084 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:47.785409 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-fac4e05e-0f60-4534-a189-bc5e440dd084 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:47.792934 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-fac4e05e-0f60-4534-a189-bc5e440dd084 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1266 microversion: 2.1 time: 0.159063 Aug 08 17:08:47.793496 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 650/1302] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:47 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:48.813538 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-703c7b61-28aa-4927-8db0-699ec89a5dd5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:48.814407 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-703c7b61-28aa-4927-8db0-699ec89a5dd5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:48.821935 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-703c7b61-28aa-4927-8db0-699ec89a5dd5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:48.822426 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-703c7b61-28aa-4927-8db0-699ec89a5dd5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:48.823029 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-703c7b61-28aa-4927-8db0-699ec89a5dd5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:48.823738 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-703c7b61-28aa-4927-8db0-699ec89a5dd5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:48.824220 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-703c7b61-28aa-4927-8db0-699ec89a5dd5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:48.824814 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-703c7b61-28aa-4927-8db0-699ec89a5dd5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:48.962584 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-703c7b61-28aa-4927-8db0-699ec89a5dd5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:48.970022 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-703c7b61-28aa-4927-8db0-699ec89a5dd5 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1266 microversion: 2.1 time: 0.160598 Aug 08 17:08:48.970832 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 653/1303] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:48 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:49.991988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-af1e499a-47f0-437e-96e6-67fa79dd9653 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:49.992600 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-af1e499a-47f0-437e-96e6-67fa79dd9653 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:49.998987 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-af1e499a-47f0-437e-96e6-67fa79dd9653 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:49.999466 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-af1e499a-47f0-437e-96e6-67fa79dd9653 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:49.999898 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-af1e499a-47f0-437e-96e6-67fa79dd9653 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:50.000611 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-af1e499a-47f0-437e-96e6-67fa79dd9653 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:50.001060 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-af1e499a-47f0-437e-96e6-67fa79dd9653 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:50.001510 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-af1e499a-47f0-437e-96e6-67fa79dd9653 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:50.133468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-af1e499a-47f0-437e-96e6-67fa79dd9653 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:50.141064 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-af1e499a-47f0-437e-96e6-67fa79dd9653 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1266 microversion: 2.1 time: 0.154025 Aug 08 17:08:50.141622 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 651/1304] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:49 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:50.477808 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [req-e11d04f8-b4c4-4688-af90-32eac71a3330 req-345b7c79-05c9-4844-a6d0-e21503b56ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26af014-0153-4463-9afe-4be72de01b7c", "name": "network-vif-plugged", "status": "completed", "tag": "f64e465b-7cd7-43dc-8b14-7b4ddd29fa47"}]} {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:08:50.487762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-e11d04f8-b4c4-4688-af90-32eac71a3330 req-345b7c79-05c9-4844-a6d0-e21503b56ae4 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:50.488402 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-e11d04f8-b4c4-4688-af90-32eac71a3330 req-345b7c79-05c9-4844-a6d0-e21503b56ae4 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:50.488838 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [req-e11d04f8-b4c4-4688-af90-32eac71a3330 req-345b7c79-05c9-4844-a6d0-e21503b56ae4 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:50.499556 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.compute.server_external_events [req-e11d04f8-b4c4-4688-af90-32eac71a3330 req-345b7c79-05c9-4844-a6d0-e21503b56ae4 service nova] Creating event network-vif-plugged:f64e465b-7cd7-43dc-8b14-7b4ddd29fa47 for instance b26af014-0153-4463-9afe-4be72de01b7c on hv-cinder-85220 Aug 08 17:08:50.504757 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [req-e11d04f8-b4c4-4688-af90-32eac71a3330 req-345b7c79-05c9-4844-a6d0-e21503b56ae4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030892 Aug 08 17:08:50.505365 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 654/1305] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:08:51.161472 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-991a251f-e42e-4c2f-bb74-672d778a9b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:51.162092 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-991a251f-e42e-4c2f-bb74-672d778a9b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:51.168553 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-991a251f-e42e-4c2f-bb74-672d778a9b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:51.169045 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-991a251f-e42e-4c2f-bb74-672d778a9b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:51.169483 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-991a251f-e42e-4c2f-bb74-672d778a9b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:51.170176 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-991a251f-e42e-4c2f-bb74-672d778a9b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:51.170657 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-991a251f-e42e-4c2f-bb74-672d778a9b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:51.171083 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-991a251f-e42e-4c2f-bb74-672d778a9b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:51.303904 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-991a251f-e42e-4c2f-bb74-672d778a9b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:51.311450 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-991a251f-e42e-4c2f-bb74-672d778a9b9f tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1266 microversion: 2.1 time: 0.153954 Aug 08 17:08:51.312018 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 652/1306] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:51 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:52.334374 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-ac4dceb3-9793-482b-9986-7b1bfb5df763 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:52.335020 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-ac4dceb3-9793-482b-9986-7b1bfb5df763 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:52.341231 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac4dceb3-9793-482b-9986-7b1bfb5df763 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:52.341717 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac4dceb3-9793-482b-9986-7b1bfb5df763 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:52.342155 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac4dceb3-9793-482b-9986-7b1bfb5df763 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:52.342878 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac4dceb3-9793-482b-9986-7b1bfb5df763 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:52.343338 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac4dceb3-9793-482b-9986-7b1bfb5df763 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:52.343762 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-ac4dceb3-9793-482b-9986-7b1bfb5df763 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:52.484022 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-ac4dceb3-9793-482b-9986-7b1bfb5df763 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:52.492516 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-ac4dceb3-9793-482b-9986-7b1bfb5df763 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1266 microversion: 2.1 time: 0.163506 Aug 08 17:08:52.493084 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 655/1307] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:52 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:53.513585 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-20ebbd5f-fc68-4525-893c-920e1ddfa65b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:53.514143 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-20ebbd5f-fc68-4525-893c-920e1ddfa65b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:53.521681 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-20ebbd5f-fc68-4525-893c-920e1ddfa65b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:53.522161 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-20ebbd5f-fc68-4525-893c-920e1ddfa65b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:53.522611 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-20ebbd5f-fc68-4525-893c-920e1ddfa65b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:53.523299 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-20ebbd5f-fc68-4525-893c-920e1ddfa65b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:53.523747 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-20ebbd5f-fc68-4525-893c-920e1ddfa65b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:53.524165 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-20ebbd5f-fc68-4525-893c-920e1ddfa65b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:53.657288 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-20ebbd5f-fc68-4525-893c-920e1ddfa65b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:53.665018 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-20ebbd5f-fc68-4525-893c-920e1ddfa65b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1453 microversion: 2.1 time: 0.155373 Aug 08 17:08:53.665583 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 653/1308] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:53 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:53.685221 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-848b1ae1-8787-46ab-bcb5-1a62d383d6b7 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:08:53.685845 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-848b1ae1-8787-46ab-bcb5-1a62d383d6b7 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:08:53.693024 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-848b1ae1-8787-46ab-bcb5-1a62d383d6b7 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:53.702829 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-848b1ae1-8787-46ab-bcb5-1a62d383d6b7 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:53.702829 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-848b1ae1-8787-46ab-bcb5-1a62d383d6b7 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:53.702829 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-848b1ae1-8787-46ab-bcb5-1a62d383d6b7 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:53.702829 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-848b1ae1-8787-46ab-bcb5-1a62d383d6b7 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:53.703308 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-848b1ae1-8787-46ab-bcb5-1a62d383d6b7 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:53.828495 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-848b1ae1-8787-46ab-bcb5-1a62d383d6b7 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:08:53.837217 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-848b1ae1-8787-46ab-bcb5-1a62d383d6b7 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1453 microversion: 2.1 time: 0.155766 Aug 08 17:08:53.837776 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 656/1309] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:08:53 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:08:55.734870 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-152ff743-4975-4705-82b7-db2818015750 req-c84a375a-ec03-405c-8bc9-879fbb5e87af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26af014-0153-4463-9afe-4be72de01b7c", "tag": "f64e465b-7cd7-43dc-8b14-7b4ddd29fa47"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:08:55.745261 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-152ff743-4975-4705-82b7-db2818015750 req-c84a375a-ec03-405c-8bc9-879fbb5e87af service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:08:55.745805 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-152ff743-4975-4705-82b7-db2818015750 req-c84a375a-ec03-405c-8bc9-879fbb5e87af service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:08:55.746245 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-152ff743-4975-4705-82b7-db2818015750 req-c84a375a-ec03-405c-8bc9-879fbb5e87af service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:08:55.757468 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-152ff743-4975-4705-82b7-db2818015750 req-c84a375a-ec03-405c-8bc9-879fbb5e87af service nova] Creating event network-changed:f64e465b-7cd7-43dc-8b14-7b4ddd29fa47 for instance b26af014-0153-4463-9afe-4be72de01b7c on hv-cinder-85220 Aug 08 17:08:55.762767 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-152ff743-4975-4705-82b7-db2818015750 req-c84a375a-ec03-405c-8bc9-879fbb5e87af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031569 Aug 08 17:08:55.763549 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 654/1310] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:18.600869 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_api:SELECT=22 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:10:18.601799 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG dbcounter [-] [130236] Writing DB stats nova_cell1:SELECT=46 {{(pid=130236) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:10:18.607395 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-65ece927-77ef-40a1-b096-8ce51ca6775d req-eeeaf331-3bb6-4b6d-ab8b-bc44041c39c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26af014-0153-4463-9afe-4be72de01b7c", "tag": "f64e465b-7cd7-43dc-8b14-7b4ddd29fa47"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:10:18.608400 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-17644981-bf8e-418d-8c6c-79e719a29b9b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:18.608906 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-17644981-bf8e-418d-8c6c-79e719a29b9b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:18.614053 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:10:18.618009 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG dbcounter [-] [130235] Writing DB stats nova_cell1:SELECT=58 {{(pid=130235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 17:10:18.618135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-17644981-bf8e-418d-8c6c-79e719a29b9b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:18.618135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-17644981-bf8e-418d-8c6c-79e719a29b9b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:18.618135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-17644981-bf8e-418d-8c6c-79e719a29b9b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:18.618135 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-17644981-bf8e-418d-8c6c-79e719a29b9b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:18.618493 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-17644981-bf8e-418d-8c6c-79e719a29b9b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:18.618493 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-17644981-bf8e-418d-8c6c-79e719a29b9b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:18.619109 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-65ece927-77ef-40a1-b096-8ce51ca6775d req-eeeaf331-3bb6-4b6d-ab8b-bc44041c39c8 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:18.619572 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-65ece927-77ef-40a1-b096-8ce51ca6775d req-eeeaf331-3bb6-4b6d-ab8b-bc44041c39c8 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:18.620007 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-65ece927-77ef-40a1-b096-8ce51ca6775d req-eeeaf331-3bb6-4b6d-ab8b-bc44041c39c8 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:18.631789 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-65ece927-77ef-40a1-b096-8ce51ca6775d req-eeeaf331-3bb6-4b6d-ab8b-bc44041c39c8 service nova] Creating event network-changed:f64e465b-7cd7-43dc-8b14-7b4ddd29fa47 for instance b26af014-0153-4463-9afe-4be72de01b7c on hv-cinder-85220 Aug 08 17:10:18.637778 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-65ece927-77ef-40a1-b096-8ce51ca6775d req-eeeaf331-3bb6-4b6d-ab8b-bc44041c39c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036026 Aug 08 17:10:18.638378 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 655/1311] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 17:10:18.651014 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-17644981-bf8e-418d-8c6c-79e719a29b9b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:10:18.964355 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-17644981-bf8e-418d-8c6c-79e719a29b9b tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 204 len: 0 microversion: 2.1 time: 0.365189 Aug 08 17:10:18.968120 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 657/1312] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:10:18 2022] DELETE /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:10:18.974318 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-98b3287d-c13a-42f4-94d0-3028ce90afec tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:18.975523 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-98b3287d-c13a-42f4-94d0-3028ce90afec tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:18.984316 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-98b3287d-c13a-42f4-94d0-3028ce90afec tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:18.984709 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-98b3287d-c13a-42f4-94d0-3028ce90afec tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:18.985406 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-98b3287d-c13a-42f4-94d0-3028ce90afec tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:18.986082 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-98b3287d-c13a-42f4-94d0-3028ce90afec tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:18.986538 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-98b3287d-c13a-42f4-94d0-3028ce90afec tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:18.986999 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-98b3287d-c13a-42f4-94d0-3028ce90afec tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:19.129079 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-98b3287d-c13a-42f4-94d0-3028ce90afec tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:19.137837 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-98b3287d-c13a-42f4-94d0-3028ce90afec tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1577 microversion: 2.1 time: 0.168423 Aug 08 17:10:19.138423 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 656/1313] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:18 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:10:20.040296 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:10:20.040905 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Mon Aug 8 17:10:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:10:20.160644 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-c7062b68-783d-49a7-9f32-f063c29836ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:20.161568 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-c7062b68-783d-49a7-9f32-f063c29836ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:20.170216 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c7062b68-783d-49a7-9f32-f063c29836ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:20.170729 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c7062b68-783d-49a7-9f32-f063c29836ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:20.171164 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c7062b68-783d-49a7-9f32-f063c29836ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:20.171853 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c7062b68-783d-49a7-9f32-f063c29836ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:20.172324 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c7062b68-783d-49a7-9f32-f063c29836ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:20.172745 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-c7062b68-783d-49a7-9f32-f063c29836ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:20.314718 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-c7062b68-783d-49a7-9f32-f063c29836ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:20.322269 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-c7062b68-783d-49a7-9f32-f063c29836ac tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1577 microversion: 2.1 time: 0.165983 Aug 08 17:10:20.322861 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 658/1314] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:20 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:10:21.036367 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-669585a1-fb8f-4d8e-b07c-82027f8718d8 req-f989ab19-8402-4d42-b9eb-84edf1372029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26af014-0153-4463-9afe-4be72de01b7c", "name": "network-vif-deleted", "tag": "f64e465b-7cd7-43dc-8b14-7b4ddd29fa47"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:10:21.046878 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-669585a1-fb8f-4d8e-b07c-82027f8718d8 req-f989ab19-8402-4d42-b9eb-84edf1372029 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:21.047357 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-669585a1-fb8f-4d8e-b07c-82027f8718d8 req-f989ab19-8402-4d42-b9eb-84edf1372029 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:21.047784 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-669585a1-fb8f-4d8e-b07c-82027f8718d8 req-f989ab19-8402-4d42-b9eb-84edf1372029 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:21.058912 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-669585a1-fb8f-4d8e-b07c-82027f8718d8 req-f989ab19-8402-4d42-b9eb-84edf1372029 service nova] Creating event network-vif-deleted:f64e465b-7cd7-43dc-8b14-7b4ddd29fa47 for instance b26af014-0153-4463-9afe-4be72de01b7c on hv-cinder-85220 Aug 08 17:10:21.063813 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-669585a1-fb8f-4d8e-b07c-82027f8718d8 req-f989ab19-8402-4d42-b9eb-84edf1372029 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031157 Aug 08 17:10:21.064493 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 657/1315] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:21.344091 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-00ad3aeb-437f-4aab-b9b7-9ffb1a4d87aa tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:21.344716 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-00ad3aeb-437f-4aab-b9b7-9ffb1a4d87aa tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:21.351425 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00ad3aeb-437f-4aab-b9b7-9ffb1a4d87aa tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:21.352154 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00ad3aeb-437f-4aab-b9b7-9ffb1a4d87aa tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:21.352603 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00ad3aeb-437f-4aab-b9b7-9ffb1a4d87aa tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:21.353305 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00ad3aeb-437f-4aab-b9b7-9ffb1a4d87aa tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:21.354028 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00ad3aeb-437f-4aab-b9b7-9ffb1a4d87aa tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:21.354604 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-00ad3aeb-437f-4aab-b9b7-9ffb1a4d87aa tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:21.418368 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-00ad3aeb-437f-4aab-b9b7-9ffb1a4d87aa tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:21.426228 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-00ad3aeb-437f-4aab-b9b7-9ffb1a4d87aa tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 200 len: 1226 microversion: 2.1 time: 0.086028 Aug 08 17:10:21.427092 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 659/1316] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:21 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:10:22.449027 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-285d3d20-dee9-4ddf-b083-cb221b9e3ffe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:22.449732 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-285d3d20-dee9-4ddf-b083-cb221b9e3ffe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: b26af014-0153-4463-9afe-4be72de01b7c] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:22.456286 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-285d3d20-dee9-4ddf-b083-cb221b9e3ffe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:22.456704 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-285d3d20-dee9-4ddf-b083-cb221b9e3ffe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:22.457138 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-285d3d20-dee9-4ddf-b083-cb221b9e3ffe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:22.457834 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-285d3d20-dee9-4ddf-b083-cb221b9e3ffe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:22.458338 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-285d3d20-dee9-4ddf-b083-cb221b9e3ffe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:22.458795 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-285d3d20-dee9-4ddf-b083-cb221b9e3ffe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:22.479179 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-285d3d20-dee9-4ddf-b083-cb221b9e3ffe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] HTTP exception thrown: Instance b26af014-0153-4463-9afe-4be72de01b7c could not be found. Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-285d3d20-dee9-4ddf-b083-cb221b9e3ffe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Request method failure captured: Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c HTTP/1.1 Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8UH0eoXDfbkju0gxWBu5sD0ewra8m2060haz0mGs7uraa9NTYzirDS8qCjCpK8NhOkC_Kx7_bxKeQEPuzSFJLNXqcW7CWkmepH_OhVaEGkODQJOihKpE0RpmomyJevWhSAlzGy3N6EDEKMRdQqf7mTTDzjBOu_wtEiTjceiiiqotqzw Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: f30f18b2d4fe4a9fa54fce853aa4c5cf Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:10:22.482169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:10:22.484716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f30f18b2d4fe4a9fa54fce853aa4c5cf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:10:22.484716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:10:22.484716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: f30f18b2d4fe4a9fa54fce853aa4c5cf Aug 08 17:10:22.484716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:10:22.484716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-TestVolumeBootPattern-1721055160-project Aug 08 17:10:22.484716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:10:22.484716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:10:22.484716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: bd48464ff95749cd8b36b2fea90ddb31 Aug 08 17:10:22.484716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-TestVolumeBootPattern-1721055160-project Aug 08 17:10:22.484716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:10:22.484716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance b26af014-0153-4463-9afe-4be72de01b7c could not be found. Aug 08 17:10:22.484716 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': 'b26af014-0153-4463-9afe-4be72de01b7c'} Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26af014-0153-4463-9afe-4be72de01b7c could not be found. Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:10:22.485822 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26af014-0153-4463-9afe-4be72de01b7c could not be found. Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26af014-0153-4463-9afe-4be72de01b7c could not be found. Aug 08 17:10:22.487643 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:22.489426 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-285d3d20-dee9-4ddf-b083-cb221b9e3ffe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Returning 404 to user: Instance b26af014-0153-4463-9afe-4be72de01b7c could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:10:22.489426 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-285d3d20-dee9-4ddf-b083-cb221b9e3ffe tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c" status: 404 len: 111 microversion: 2.1 time: 0.039068 Aug 08 17:10:22.489426 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 658/1317] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:22 2022] GET /compute/v2.1/servers/b26af014-0153-4463-9afe-4be72de01b7c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:10:25.084200 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:10:25.084777 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Mon Aug 8 17:10:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:10:25.849717 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-f3c60301-8744-4935-bb90-897a815aea9a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:25.850349 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f3c60301-8744-4935-bb90-897a815aea9a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:25.851502 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-29dc5f57-7f0b-4f14-8340-a08c46cd79a5 req-b926d67f-c8fb-477a-85ef-764726b81181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b3cda4-6c2b-4fc9-b300-6e5d65027cf5", "tag": "53165425-ada3-43b2-b6f7-01399a8c3ebc"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:10:25.857805 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f3c60301-8744-4935-bb90-897a815aea9a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:25.858287 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f3c60301-8744-4935-bb90-897a815aea9a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:25.858937 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f3c60301-8744-4935-bb90-897a815aea9a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:25.859872 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f3c60301-8744-4935-bb90-897a815aea9a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:25.860589 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f3c60301-8744-4935-bb90-897a815aea9a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:25.861228 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-f3c60301-8744-4935-bb90-897a815aea9a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:25.862674 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-29dc5f57-7f0b-4f14-8340-a08c46cd79a5 req-b926d67f-c8fb-477a-85ef-764726b81181 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:25.863680 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-29dc5f57-7f0b-4f14-8340-a08c46cd79a5 req-b926d67f-c8fb-477a-85ef-764726b81181 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:25.864298 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-29dc5f57-7f0b-4f14-8340-a08c46cd79a5 req-b926d67f-c8fb-477a-85ef-764726b81181 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:25.876013 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-29dc5f57-7f0b-4f14-8340-a08c46cd79a5 req-b926d67f-c8fb-477a-85ef-764726b81181 service nova] Creating event network-changed:53165425-ada3-43b2-b6f7-01399a8c3ebc for instance 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 on hv-cinder-85220 Aug 08 17:10:25.881323 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-29dc5f57-7f0b-4f14-8340-a08c46cd79a5 req-b926d67f-c8fb-477a-85ef-764726b81181 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033520 Aug 08 17:10:25.882684 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 659/1318] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:25.888998 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-f3c60301-8744-4935-bb90-897a815aea9a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Going to try to terminate instance {{(pid=130236) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 17:10:26.153803 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-f3c60301-8744-4935-bb90-897a815aea9a tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "DELETE /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 204 len: 0 microversion: 2.1 time: 0.306792 Aug 08 17:10:26.156291 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 660/1319] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:10:25 2022] DELETE /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 17:10:26.167022 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-79f239b4-122f-485e-9ad6-832d8c51760d tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:26.169430 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-79f239b4-122f-485e-9ad6-832d8c51760d tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:26.176937 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-79f239b4-122f-485e-9ad6-832d8c51760d tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:26.177722 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-79f239b4-122f-485e-9ad6-832d8c51760d tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:26.178219 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-79f239b4-122f-485e-9ad6-832d8c51760d tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:26.179017 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-79f239b4-122f-485e-9ad6-832d8c51760d tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:26.179466 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-79f239b4-122f-485e-9ad6-832d8c51760d tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:26.179887 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-79f239b4-122f-485e-9ad6-832d8c51760d tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:26.321740 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.policy [None req-79f239b4-122f-485e-9ad6-832d8c51760d tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130235) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:26.330354 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-79f239b4-122f-485e-9ad6-832d8c51760d tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1576 microversion: 2.1 time: 0.169710 Aug 08 17:10:26.330975 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 660/1320] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:26 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:10:27.352428 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-903b2080-1d0f-4cef-a19d-3f84d51365df tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:27.353171 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-903b2080-1d0f-4cef-a19d-3f84d51365df tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:27.360320 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-903b2080-1d0f-4cef-a19d-3f84d51365df tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:27.361295 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-903b2080-1d0f-4cef-a19d-3f84d51365df tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:27.361295 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-903b2080-1d0f-4cef-a19d-3f84d51365df tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:27.361918 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-903b2080-1d0f-4cef-a19d-3f84d51365df tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:27.362374 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-903b2080-1d0f-4cef-a19d-3f84d51365df tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:27.362824 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-903b2080-1d0f-4cef-a19d-3f84d51365df tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:27.496437 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-903b2080-1d0f-4cef-a19d-3f84d51365df tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:27.504516 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-903b2080-1d0f-4cef-a19d-3f84d51365df tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1576 microversion: 2.1 time: 0.156414 Aug 08 17:10:27.505114 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 661/1321] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:27 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:10:28.182947 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [req-97cf5455-1367-496b-800f-25247aa90cfd req-c98ff127-5f20-4964-974b-fbe1560e77c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b3cda4-6c2b-4fc9-b300-6e5d65027cf5", "name": "network-vif-deleted", "tag": "53165425-ada3-43b2-b6f7-01399a8c3ebc"}]} {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 17:10:28.193533 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-97cf5455-1367-496b-800f-25247aa90cfd req-c98ff127-5f20-4964-974b-fbe1560e77c9 service nova] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:28.194003 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-97cf5455-1367-496b-800f-25247aa90cfd req-c98ff127-5f20-4964-974b-fbe1560e77c9 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:28.194472 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [req-97cf5455-1367-496b-800f-25247aa90cfd req-c98ff127-5f20-4964-974b-fbe1560e77c9 service nova] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:28.206171 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.compute.server_external_events [req-97cf5455-1367-496b-800f-25247aa90cfd req-c98ff127-5f20-4964-974b-fbe1560e77c9 service nova] Creating event network-vif-deleted:53165425-ada3-43b2-b6f7-01399a8c3ebc for instance 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 on hv-cinder-85220 Aug 08 17:10:28.211052 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [req-97cf5455-1367-496b-800f-25247aa90cfd req-c98ff127-5f20-4964-974b-fbe1560e77c9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031789 Aug 08 17:10:28.211646 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 661/1322] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Aug 8 17:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 17:10:28.525915 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-61ae98c4-7e7f-41ef-afd9-e8b4ac51d29c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:28.526527 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-61ae98c4-7e7f-41ef-afd9-e8b4ac51d29c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:28.534304 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-61ae98c4-7e7f-41ef-afd9-e8b4ac51d29c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:28.534724 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-61ae98c4-7e7f-41ef-afd9-e8b4ac51d29c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:28.535233 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-61ae98c4-7e7f-41ef-afd9-e8b4ac51d29c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:28.535897 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-61ae98c4-7e7f-41ef-afd9-e8b4ac51d29c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:28.536352 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-61ae98c4-7e7f-41ef-afd9-e8b4ac51d29c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:28.536780 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-61ae98c4-7e7f-41ef-afd9-e8b4ac51d29c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:28.612254 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.policy [None req-61ae98c4-7e7f-41ef-afd9-e8b4ac51d29c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd48464ff95749cd8b36b2fea90ddb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30f18b2d4fe4a9fa54fce853aa4c5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130236) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 17:10:28.620084 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-61ae98c4-7e7f-41ef-afd9-e8b4ac51d29c tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 200 len: 1226 microversion: 2.1 time: 0.098343 Aug 08 17:10:28.620636 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 662/1323] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:28 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 17:10:29.642143 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8fc9f77a-461e-453b-b8b1-b0519a5ebff8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:29.642883 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-8fc9f77a-461e-453b-b8b1-b0519a5ebff8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:29.649018 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8fc9f77a-461e-453b-b8b1-b0519a5ebff8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:29.649503 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8fc9f77a-461e-453b-b8b1-b0519a5ebff8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:29.651093 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8fc9f77a-461e-453b-b8b1-b0519a5ebff8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:29.651093 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8fc9f77a-461e-453b-b8b1-b0519a5ebff8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:29.651093 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8fc9f77a-461e-453b-b8b1-b0519a5ebff8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:29.651602 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-8fc9f77a-461e-453b-b8b1-b0519a5ebff8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:29.665858 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-8fc9f77a-461e-453b-b8b1-b0519a5ebff8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] HTTP exception thrown: Instance 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 could not be found. Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8fc9f77a-461e-453b-b8b1-b0519a5ebff8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Request method failure captured: Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 HTTP/1.1 Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8UH0eoXDfbkju0gxWBu5sD0ewra8m2060haz0mGs7uraa9NTYzirDS8qCjCpK8NhOkC_Kx7_bxKeQEPuzSFJLNXqcW7CWkmepH_OhVaEGkODQJOihKpE0RpmomyJevWhSAlzGy3N6EDEKMRdQqf7mTTDzjBOu_wtEiTjceiiiqotqzw Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: f30f18b2d4fe4a9fa54fce853aa4c5cf Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:10:29.667545 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:10:29.669349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f30f18b2d4fe4a9fa54fce853aa4c5cf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:10:29.669349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:10:29.669349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: f30f18b2d4fe4a9fa54fce853aa4c5cf Aug 08 17:10:29.669349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:10:29.669349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-TestVolumeBootPattern-1721055160-project Aug 08 17:10:29.669349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:10:29.669349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:10:29.669349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: bd48464ff95749cd8b36b2fea90ddb31 Aug 08 17:10:29.669349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-TestVolumeBootPattern-1721055160-project Aug 08 17:10:29.669349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:10:29.669349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 could not be found. Aug 08 17:10:29.669349 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '75b3cda4-6c2b-4fc9-b300-6e5d65027cf5'} Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 could not be found. Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:10:29.671317 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 could not be found. Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 could not be found. Aug 08 17:10:29.672922 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:29.675124 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-8fc9f77a-461e-453b-b8b1-b0519a5ebff8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Returning 404 to user: Instance 75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:10:29.675124 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-8fc9f77a-461e-453b-b8b1-b0519a5ebff8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5" status: 404 len: 111 microversion: 2.1 time: 0.031672 Aug 08 17:10:29.675124 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 662/1324] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:29 2022] GET /compute/v2.1/servers/75b3cda4-6c2b-4fc9-b300-6e5d65027cf5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:10:30.208054 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-876478f2-2dbf-47c7-b22c-9677ead28ad8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:30.208568 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.compute.api [None req-876478f2-2dbf-47c7-b22c-9677ead28ad8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130236) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:30.215000 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-876478f2-2dbf-47c7-b22c-9677ead28ad8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:30.215509 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-876478f2-2dbf-47c7-b22c-9677ead28ad8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:30.215940 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-876478f2-2dbf-47c7-b22c-9677ead28ad8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:30.216653 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-876478f2-2dbf-47c7-b22c-9677ead28ad8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:30.217732 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-876478f2-2dbf-47c7-b22c-9677ead28ad8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:30.218161 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG oslo_concurrency.lockutils [None req-876478f2-2dbf-47c7-b22c-9677ead28ad8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130236) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:30.231422 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.wsgi [None req-876478f2-2dbf-47c7-b22c-9677ead28ad8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] HTTP exception thrown: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-876478f2-2dbf-47c7-b22c-9677ead28ad8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Request method failure captured: Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: request: DELETE /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 HTTP/1.1 Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept: application/json Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Accept-Encoding: identity Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Connection: close Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Length: 0 Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Content-Type: application/json Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Host: 10.222.0.13 Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Openstack-System-Scope: None Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: User-Agent: python-urllib3/1.26.11 Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Auth-Token: gAAAAABi8UH0eoXDfbkju0gxWBu5sD0ewra8m2060haz0mGs7uraa9NTYzirDS8qCjCpK8NhOkC_Kx7_bxKeQEPuzSFJLNXqcW7CWkmepH_OhVaEGkODQJOihKpE0RpmomyJevWhSAlzGy3N6EDEKMRdQqf7mTTDzjBOu_wtEiTjceiiiqotqzw Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Id: None Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Domain-Name: None Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Identity-Status: Confirmed Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Is-Admin-Project: True Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Id: default Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Domain-Name: Default Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Id: f30f18b2d4fe4a9fa54fce853aa4c5cf Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Project-Name: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Role: reader,member Aug 08 17:10:30.233101 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Roles: reader,member Aug 08 17:10:30.240053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f30f18b2d4fe4a9fa54fce853aa4c5cf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:10:30.240053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:10:30.240053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Id: f30f18b2d4fe4a9fa54fce853aa4c5cf Aug 08 17:10:30.240053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-Tenant-Name: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:10:30.240053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User: tempest-TestVolumeBootPattern-1721055160-project Aug 08 17:10:30.240053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Id: default Aug 08 17:10:30.240053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Domain-Name: Default Aug 08 17:10:30.240053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Id: bd48464ff95749cd8b36b2fea90ddb31 Aug 08 17:10:30.240053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: X-User-Name: tempest-TestVolumeBootPattern-1721055160-project Aug 08 17:10:30.240053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: method: > Aug 08 17:10:30.240053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: exception: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:10:30.240053 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: action_args: {'id': '622725fc-56b2-4713-b7ff-8f52c495c402'} Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:10:30.241145 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:10:30.243018 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: ERROR nova.api.openstack.wsgi Aug 08 17:10:30.244712 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-876478f2-2dbf-47c7-b22c-9677ead28ad8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Returning 404 to user: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. {{(pid=130236) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:10:30.244712 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-876478f2-2dbf-47c7-b22c-9677ead28ad8 tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "DELETE /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 404 len: 111 microversion: 2.1 time: 0.030717 Aug 08 17:10:30.244712 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 663/1325] 10.222.0.13 () {58 vars in 1239 bytes} [Mon Aug 8 17:10:30 2022] DELETE /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:10:30.246751 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-52797710-38e9-41fa-94b5-7498b7e197eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '>' {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:30.247364 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.compute.api [None req-52797710-38e9-41fa-94b5-7498b7e197eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] [instance: 622725fc-56b2-4713-b7ff-8f52c495c402] Fetching instance by UUID {{(pid=130235) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 17:10:30.253436 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-52797710-38e9-41fa-94b5-7498b7e197eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:30.253921 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-52797710-38e9-41fa-94b5-7498b7e197eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:30.254443 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-52797710-38e9-41fa-94b5-7498b7e197eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:30.255161 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-52797710-38e9-41fa-94b5-7498b7e197eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Acquiring lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 17:10:30.255634 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-52797710-38e9-41fa-94b5-7498b7e197eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 17:10:30.256037 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG oslo_concurrency.lockutils [None req-52797710-38e9-41fa-94b5-7498b7e197eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Lock "24395fe2-62ef-4f67-8fb3-2dbb6cef8108" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 17:10:30.271638 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.wsgi [None req-52797710-38e9-41fa-94b5-7498b7e197eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] HTTP exception thrown: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-52797710-38e9-41fa-94b5-7498b7e197eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Request method failure captured: Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: request: GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 HTTP/1.1 Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept: application/json Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Accept-Encoding: identity Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Connection: close Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Length: 0 Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Content-Type: application/json Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Host: 10.222.0.13 Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Openstack-System-Scope: None Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: User-Agent: python-urllib3/1.26.11 Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Auth-Token: gAAAAABi8UH0eoXDfbkju0gxWBu5sD0ewra8m2060haz0mGs7uraa9NTYzirDS8qCjCpK8NhOkC_Kx7_bxKeQEPuzSFJLNXqcW7CWkmepH_OhVaEGkODQJOihKpE0RpmomyJevWhSAlzGy3N6EDEKMRdQqf7mTTDzjBOu_wtEiTjceiiiqotqzw Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Id: None Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Domain-Name: None Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Identity-Status: Confirmed Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Is-Admin-Project: True Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Id: default Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Domain-Name: Default Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Id: f30f18b2d4fe4a9fa54fce853aa4c5cf Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Project-Name: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Role: reader,member Aug 08 17:10:30.273169 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Roles: reader,member Aug 08 17:10:30.274988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f30f18b2d4fe4a9fa54fce853aa4c5cf", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f30f18b2d4fe4a9fa54fce853aa4c5cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 08 17:10:30.274988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:10:30.274988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Id: f30f18b2d4fe4a9fa54fce853aa4c5cf Aug 08 17:10:30.274988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-Tenant-Name: tempest-TestVolumeBootPattern-1721055160 Aug 08 17:10:30.274988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User: tempest-TestVolumeBootPattern-1721055160-project Aug 08 17:10:30.274988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Id: default Aug 08 17:10:30.274988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Domain-Name: Default Aug 08 17:10:30.274988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Id: bd48464ff95749cd8b36b2fea90ddb31 Aug 08 17:10:30.274988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: X-User-Name: tempest-TestVolumeBootPattern-1721055160-project Aug 08 17:10:30.274988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: method: > Aug 08 17:10:30.274988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: exception: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:10:30.274988 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: action_args: {'id': '622725fc-56b2-4713-b7ff-8f52c495c402'} Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: {{(pid=130235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 17:10:30.276100 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. Aug 08 17:10:30.277689 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: ERROR nova.api.openstack.wsgi Aug 08 17:10:30.279266 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: DEBUG nova.api.openstack.wsgi [None req-52797710-38e9-41fa-94b5-7498b7e197eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Returning 404 to user: Instance 622725fc-56b2-4713-b7ff-8f52c495c402 could not be found. {{(pid=130235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 17:10:30.279266 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO nova.api.openstack.requestlog [None req-52797710-38e9-41fa-94b5-7498b7e197eb tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402" status: 404 len: 111 microversion: 2.1 time: 0.031631 Aug 08 17:10:30.279266 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: [pid: 130235|app: 0|req: 663/1326] 10.222.0.13 () {58 vars in 1236 bytes} [Mon Aug 8 17:10:30 2022] GET /compute/v2.1/servers/622725fc-56b2-4713-b7ff-8f52c495c402 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 17:10:31.774205 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: DEBUG nova.api.openstack.wsgi [None req-9e7a157e-21ae-4c90-89c6-f82ae613881e tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] Calling method '.version_select at 0x7f501a921940>' {{(pid=130236) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 17:10:31.861383 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO nova.api.openstack.requestlog [None req-9e7a157e-21ae-4c90-89c6-f82ae613881e tempest-TestVolumeBootPattern-1721055160 tempest-TestVolumeBootPattern-1721055160-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1799878524" status: 202 len: 0 microversion: 2.1 time: 0.091016 Aug 08 17:10:31.861960 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: [pid: 130236|app: 0|req: 664/1327] 10.222.0.13 () {58 vars in 1263 bytes} [Mon Aug 8 17:10:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1799878524 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 17:12:04.359114 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:12:04.359757 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Mon Aug 8 17:12:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:13:40.053654 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:13:40.054301 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Mon Aug 8 17:13:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:13:45.092476 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:13:45.093188 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Mon Aug 8 17:13:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:13:50.913309 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:13:50.913955 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Mon Aug 8 17:13:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:15:24.367814 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:15:24.368537 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Mon Aug 8 17:15:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:15:42.704437 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:15:42.705072 dv-cinder-852209-3-iscsi devstack@n-api.service[130236]: Mon Aug 8 17:15:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 17:15:43.939521 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 17:15:43.940138 dv-cinder-852209-3-iscsi devstack@n-api.service[130235]: Mon Aug 8 17:15:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!